Image display method and device of electronic rearview mirror, electronic equipment and storage medium

Abstract

The invention relates to an image display method and device of an electronic rearview mirror, electronic equipment and a storage medium, and relates to the technical field of control. Then analyzing the face image to determine the sight range of the driver; obtaining to-be-displayed information of a vehicle rearview mirror at a corresponding view angle according to the sight range; and displaying the to-be-displayed information of the vehicle rearview mirror in the electronic rearview mirror. According to the technical scheme, operation and setting of a user on a screen are not needed any more, the use convenience of the electronic rearview mirror is improved, and then the use experience of the user is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of control technology, and in particular to an image display method, device, electronic device and storage medium for an electronic rearview mirror. Background Art

[0002] An electronic rearview mirror refers to a product that replaces the traditional glass rearview mirror and can flexibly adjust the displayed content. The electronic rearview mirror consists of an external camera, an internal display, and an internal computing computer.

[0003] Currently, the existing electronic rearview mirror is mainly used to display the content of the traditional rearview mirror. According to the manual operation and setting of the driver on the screen, the rearview mirror angle is adjusted to display the rearview mirror content corresponding to the angle. How to flexibly display driving needs through the electronic rearview mirror is an urgent problem to be solved. Summary of the invention

[0004] In order to overcome the deficiencies of the prior art, the present disclosure provides an image display method, device, electronic device and storage medium for an electronic rearview mirror, which no longer requires manual operation and setting by the user, thereby improving the convenience of using the electronic rearview mirror and further improving the user experience.

[0005] According to a first aspect of the present disclosure, there is provided an image display method for an electronic rearview mirror, characterized in that it comprises:

[0006] Acquire a facial image of a driver; analyze the facial image to determine the driver's field of vision; acquire vehicle rearview mirror information to be displayed at a corresponding viewing angle according to the field of vision; and display the vehicle rearview mirror information to be displayed in the electronic rearview mirror.

[0007] According to this embodiment, the vehicle host can flexibly display the electronic rearview mirror based on the perception of the driver's field of vision, so the user is no longer required to operate and set up on the screen, thereby improving the convenience of using the electronic rearview mirror and further improving the user experience.

[0008] In some embodiments, analyzing the facial image to determine the driver's line of sight includes: analyzing the facial image to extract key features of line of sight movement; determining whether the driver's line of sight has moved based on the key features; if the driver's line of sight has moved, determining the driver's line of sight based on the key feature reference point and movement information of the key features.

[0009] In some embodiments, the movement information includes the direction and distance of movement, and determining the driver's field of vision based on the key feature reference point and the movement information of the key feature includes: determining the driver's field of vision based on the key feature reference point and the direction and distance of movement based on visual perception technology.

[0010] In some embodiments, the key features include face and / or pupil, and the visual perception technology is used to determine the driver's field of vision according to the key feature reference points and the direction and distance of the movement, including: if the driver's face moves and the pupil does not move, then based on the visual perception technology, the driver's field of vision is determined according to the key feature reference points and the direction and distance of the driver's face movement; if the driver's face does not move but the pupil moves, then based on the visual perception technology, the driver's field of vision is determined according to the key feature reference points and the direction and distance of the driver's eye pupil movement; if the driver's face and pupil move, then based on the visual perception technology, the driver's field of vision is determined according to the key feature reference points and the direction and distance of the driver's face and eye pupil movement.

[0011] In some embodiments, after analyzing the facial image to determine the driver's field of vision, the method further includes: obtaining status information of the vehicle; and obtaining information to be displayed on the vehicle rearview mirror of a corresponding viewing angle based on the field of vision and the vehicle status information.

[0012] In some embodiments, the vehicle status information includes vehicle speed, and obtaining the vehicle rearview mirror information to be displayed at a corresponding viewing angle according to the visual range and the vehicle status information includes: if the current vehicle speed value is greater than or equal to a preset vehicle speed threshold, then obtaining the vehicle rearview mirror information to be displayed at a far viewing angle corresponding to the visual range; if the current vehicle speed value is less than the preset vehicle speed threshold, then obtaining the vehicle rearview mirror information to be displayed at a near viewing angle corresponding to the visual range.

[0013] In some embodiments, when the vehicle status also includes information about the vehicle's surrounding conditions, the method further includes: determining whether current driving is safe based on the vehicle's surrounding conditions; when it is determined that current driving is unsafe, obtaining corresponding near-angle vehicle rearview mirror information to be displayed.

[0014] According to a second aspect of the present disclosure, there is provided an image display device for an electronic rearview mirror, comprising: a first acquisition module, configured to acquire a facial image of a driver; a determination module, configured to analyze the facial image to determine the driver's field of vision; a second acquisition module, configured to acquire information to be displayed in the vehicle rearview mirror at a corresponding viewing angle according to the field of vision; and a display module, configured to display the information to be displayed in the vehicle rearview mirror in the electronic rearview mirror.

[0015] According to a third aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to enable the computer to execute the method described in the first aspect.

[0016] According to a fourth aspect of the present disclosure, an electronic device is provided, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in the first aspect above.

[0017] According to a fifth aspect of the present disclosure, a vehicle is provided, comprising the image display device of the electronic rearview mirror as described in the second aspect above.

[0018] The image display method, device, electronic device and storage medium of the electronic rearview mirror provided by the present disclosure first obtain the driver's facial image according to this embodiment; then analyze the facial image to determine the driver's field of vision; then obtain the vehicle rearview mirror information to be displayed at the corresponding viewing angle according to the field of vision; and display the vehicle rearview mirror information to be displayed in the electronic rearview mirror. The vehicle host can obtain the driver's field of vision based on the perception of the driver's field of vision, and obtain the content to be displayed at the corresponding viewing angle according to the field of vision, and then display the content to be displayed in the rearview mirror. The user no longer needs to operate and set on the screen, and the driver's needs can be flexibly displayed through the electronic rearview mirror, which improves the convenience of using the electronic rearview mirror and improves the user's experience.

[0019] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings are used to better understand the present solution and do not constitute a limitation of the present disclosure.

[0021] Figure 1 A schematic diagram of a flow chart of an image display method of an electronic rearview mirror provided in an embodiment of the present disclosure;

[0022] Figure 2 A schematic flow chart of another image display method of an electronic rearview mirror provided in an embodiment of the present disclosure;

[0023] Figure 3 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0024] Figure 4 A schematic diagram of another application scenario provided by an embodiment of the present disclosure;

[0025] Figure 5 A schematic diagram of an example structure provided for an embodiment of the present disclosure;

[0026] Figure 6 A schematic structural diagram of an image display device for an electronic rearview mirror provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0028] The following describes an image display method, device, electronic device, and storage medium for an electronic rearview mirror according to an embodiment of the present disclosure with reference to the accompanying drawings.

[0029] Electronic rearview mirror refers to a product that replaces the traditional glass rearview mirror outside the car. It is composed of an external camera, an internal display and an internal computing computer, and can flexibly adjust the displayed content. Currently, the existing electronic rearview mirrors are mainly used to display the content of traditional rearview mirrors. How to flexibly display driving needs through electronic rearview mirrors is a problem that needs to be solved urgently.

[0030] In order to solve the above problems, the visual perception technology in the smart car cockpit and the electronic rearview mirror are integrated. According to the perception of the driver's field of vision, the electronic rearview mirror can be flexibly displayed to improve the convenience of using the electronic rearview mirror and the user experience.

[0031] Figure 1 The following is a flow chart of an image display method of an electronic rearview mirror provided in an embodiment of the present disclosure. Figure 1 As shown, the method comprises the following steps:

[0032] Step 101, obtaining a facial image of the driver.

[0033] The driver's facial image may include image information such as the driver's face and facial features.

[0034] When acquiring the facial image of the driver, the following method may be used but is not limited to it. The method includes: acquiring the facial image of the driver using an in-vehicle camera device.

[0035] Step 102: Analyze the facial image to determine the driver's line of sight.

[0036] The driver's field of view may be the driver's observation target range corresponding to the driver's field of view when the driver observes the electronic rearview mirror.

[0037] Step 103, obtaining the information to be displayed on the vehicle rearview mirror at a corresponding viewing angle according to the visual range.

[0038] When obtaining the information to be displayed in the vehicle rearview mirror of the corresponding viewing angle, the following method can be used but is not limited to it. The method includes: using an in-vehicle computing computer to send an instruction to obtain the information to be displayed in the vehicle rearview mirror of the corresponding viewing angle to an external camera device, and then obtaining the information to be displayed in the vehicle rearview mirror of the corresponding viewing angle through the external camera device and feeding it back to the in-vehicle computing computer.

[0039] Step 104: display the information to be displayed in the vehicle rearview mirror in the electronic rearview mirror.

[0040] When displaying the vehicle rearview mirror information to be displayed in the electronic rearview mirror, it can be achieved by but not limited to the following method, which includes: using an in-vehicle computing computer to process the vehicle rearview mirror information to be displayed at the corresponding viewing angle, and then displaying the processed vehicle rearview mirror information to be displayed at the corresponding viewing angle on an in-vehicle display, wherein the in-vehicle display is the display unit of the electronic rearview mirror.

[0041] According to this embodiment, the vehicle host can flexibly display the electronic rearview mirror based on the perception of the driver's field of vision and in combination with vehicle conditions such as vehicle speed and turning, so the user is no longer required to operate and set on the screen, thereby improving the convenience of using the electronic rearview mirror and further improving the user experience.

[0042] Further, as a refinement and extension of the above embodiment, in order to fully illustrate the specific implementation process of the method of this embodiment, this embodiment provides the following Figure 2 The specific method shown comprises the following steps:

[0043] Step 201, obtaining a facial image of the driver.

[0044] According to this embodiment, an in-vehicle camera is arranged in front of the driver, which is used for but not limited to collecting the driver's facial image. The in-vehicle camera can be an infrared camera, etc. When obtaining the driver's facial image, the following method can be adopted but not limited to it, which includes: the in-vehicle camera receives the instruction of collecting the driver's facial image sent by the vehicle computer, and collects the driver's facial image in real time. The in-vehicle camera can collect the driver's facial image in real time according to the preset collection trigger condition and the interval time of collecting the driver's facial image. Optionally, the interval time of collecting the driver's facial image can be a preset function value, and the corresponding interval time of collecting the driver's facial image is set according to the current vehicle speed value.

[0045] For example, the acquisition trigger condition is preset as the current vehicle is powered on and the speed is greater than 0km / h, triggering the in-car camera to collect the driver's facial image. The current vehicle is powered on and the speed is 50km / h, which meets the acquisition trigger condition. The speed of 50km / h is input into the function value of the interval time of the driver's facial image acquisition, and the interval time of the driver's facial image acquisition is obtained to be 2 seconds. Then the in-car camera acquires the driver's facial image every two seconds.

[0046] Through the specific implementation of the above embodiment, the facial image of the driver can be continuously obtained after the vehicle is started, so as to perform subsequent analysis steps. At the same time, the facial image of the driver can be obtained at different time intervals according to the speed of the vehicle, which can improve the timeliness of the image display of the electronic rearview mirror.

[0047] Step 202: Analyze the facial image to extract key features of line of sight movement.

[0048] According to this embodiment, the facial image is first analyzed to determine the driver's facial features, eye pupil features, nose features, mouth features, ear features and other features of the facial image, and then the driver's face and eye pupils are extracted as key features of line of sight movement, which may include: the driver's facial features and eye pupil features, etc.

[0049] Furthermore, when analyzing the facial image to extract the key features of the line of sight movement, the visual algorithm function of the in-vehicle camera, the in-vehicle computing computer, etc. can be used to analyze the facial image to extract the key features of the line of sight movement, and this embodiment does not limit this.

[0050] For example, by analyzing the facial image, the driver's facial features A, eye pupil features B, nose features C, mouth features D, ear features E, etc. are obtained, and then the facial features A and eye pupil features B are extracted from the above facial features A, eye pupil features B, nose features C, mouth features D, and ear features E.

[0051] Step 203: Determine whether the driver's line of sight moves according to the key feature.

[0052] According to this embodiment, the relative position of the driver's face and the in-car camera, and the relative position of the face and the pupil of the eye are fixed. By using the fixed in-car camera installation position as a reference point, when the face and the pupil of the eye move, it is possible to determine whether the driver's line of sight moves according to the changes in the relative position of the driver's face and the in-car camera, and the relative position of the face and the pupil of the eye. By identifying the key features of the facial image, the relative position of the face and the in-car camera, and the relative position of the face and the pupil of the eye are located to determine the direction of the driver's eye observation.

[0053] Optionally, the relative positions of the face and in-car camera reference points and the current face and in-car camera are compared, and the relative positions of the face and pupil reference points and the current face and pupil are compared to determine whether the driver's line of sight has moved, and the above relative positions include relative directions and relative distances. Specifically, if any of the relative directions and relative distances of the current face and in-car camera and the current face and pupil relative directions and relative distances changes, the current driver's line of sight has moved; if there is no change, the current driver's line of sight has not moved.

[0054] Exemplarily, the reference point direction of the relative position of the driver's face and the in-car camera is X-0, and the distance is Y-0, and the reference point direction of the relative position of the face and the pupil of the eye is M-0, and the distance is N-0; the current direction of the relative position of the driver's face and the in-car camera is X-1, and the distance is Y-1, and the current direction of the relative position of the face and the pupil of the eye is M-1, and the distance is N-1, then the current driver's line of sight moves.

[0055] For this embodiment, when the driver observes the electronic rearview mirror due to driving needs during driving, the observation state will be different due to different driving needs. If the current driver is driving in a straight one-way lane with no lateral vehicles, the action of observing the electronic rearview mirror can be completed by eye movement.

[0056] In some examples, the reference point direction of the relative position of the driver's face and the in-car camera is X-0, and the distance is Y-0; the reference point direction of the relative position of the face and the pupil of the eye is M-0, and the distance is N-0; the current direction of the relative position of the driver's face and the in-car camera is X-0, and the distance is Y-0; the current direction of the relative position of the face and the pupil of the eye is M-1, and the distance is N-1; then the current relative position of the driver's face and the in-car camera has not changed, but the relative position of the current face and the pupil of the eye has changed.

[0057] Through the specific implementation of the above embodiment, it is possible to determine whether the driver's line of sight has changed according to the different observation states of the driver when observing the electronic rearview mirror.

[0058] Step 204: If the driver's line of sight moves, determine the driver's line of sight according to the key feature reference point and the movement information of the key feature.

[0059] The movement information of the key feature may include: the direction and distance of movement.

[0060] Optionally, the driver's line of sight is determined based on key feature reference points and the direction and distance of movement based on visual perception technology. Wherein, visual perception technology can be a technology that can realize multiple functions such as image recognition, target tracking, image segmentation, and posture estimation by processing and analyzing image, video and other data. Figure 3 As shown, the moving angle r is known, the distance from the camera to the driver is known, and the moving distance d can be determined.

[0061] Further optionally, step 204 may specifically include: if the driver's face moves and the pupil does not move, determining the driver's field of vision based on the key feature reference point and the direction and distance of the driver's facial movement based on visual perception technology.

[0062] For example, if the driver's face moves, and the current direction of the relative position of the face and the in-car camera is X-21, the distance is Y-15, the pupil of the eye does not move, the reference point direction of the relative position of the driver's face and the in-car camera is X-0, the distance is Y-0, the reference point direction of the relative position of the face and the pupil of the eye is M-0, and the distance is N-0, then the current direction of the driver's face movement is the difference X between X-21 and X-0, and the current distance of the driver's face movement is the difference Y between Y-15 and Y-0, and then the driver's field of vision is determined based on the direction X of the driver's face movement and the distance Y of the driver's face movement.

[0063] If the driver's face does not move but the eye pupil moves, the driver's field of vision is determined based on the key feature reference point and the direction and distance of movement of the driver's eye pupil based on visual perception technology.

[0064] In some examples, if the driver's face does not move, but the pupil moves, and the current direction of the relative position of the face and the pupil is M-18, and the distance is N-33, the reference point direction of the relative position of the driver's face and the in-vehicle camera is X-0, and the distance is Y-0, and the reference point direction of the relative position of the face and the pupil is M-0, and the distance is N-0, then the current direction of movement of the driver's pupil is the difference M between M-18 and M-0, and the current distance of movement of the driver's pupil is the difference N between N-33 and N-0, and then the driver's field of vision is determined based on the direction M of the driver's pupil movement and the distance N of the driver's pupil movement.

[0065] If the driver's face and eye pupils move, the driver's field of vision is determined based on the key feature reference points and the direction and distance of movement of the driver's face and eye pupils based on visual perception technology.

[0066] For example, if the driver's face moves, and the current direction of the relative position of the face and the in-car camera is X-65, and the distance is Y-10, the pupil of the eye moves, and the current direction of the relative position of the face and the pupil of the eye is M-9, and the distance is N-24, the direction of the reference point of the relative position of the driver's face and the in-car camera is X-0, and the distance is Y-0, and the direction of the reference point of the relative position of the face and the pupil of the eye is M-0, and the distance is N-0, then the current direction of the driver's face movement is X- The difference XQ between 65 and X-0, the distance the current driver's face moves is the difference YQ between Y-10 and Y-0, the direction of the current driver's eye pupil movement is the difference MQ between M-9 and M-0, and the distance the current driver's face moves is the difference NQ between N-24 and N-0. Then, according to the direction XQ of the driver's face movement and the distance YQ of the driver's face movement, as well as the direction MQ of the driver's eye pupil movement and the distance NQ of the driver's eye pupil movement, the driver's field of vision is determined.

[0067] Optional, such as Figure 4 As shown, by presetting the direction threshold and distance threshold of the driver's facial movement, if it is greater than at least one of the direction threshold and the distance threshold, it is determined that the driver's observation state is turning his head to observe. When the driver turns his head to observe, the display screen content of the area is enlarged, which makes it easier for the driver to observe the content in the electronic rearview mirror more clearly. When changing lanes, turning around, etc., the screen is enlarged to help users see nearby obstacles clearly.

[0068] In some embodiments, whether the current driving is safe is determined based on the vehicle condition information around the vehicle; when it is determined that the current driving is unsafe, the corresponding near-angle vehicle rearview mirror information to be displayed is obtained.

[0069] When determining whether the current driving is safe based on the vehicle condition information around the vehicle, the following method may be used but is not limited to: using the vehicle radar and the external camera to sense the distance to obtain obstacle information, and then determining whether the current driving is safe based on the obstacle information. Obstacles may include objects and pedestrians.

[0070] When it is determined that the current driving is unsafe, the obstacle information sensed by the vehicle radar and the external camera through the distance will be displayed on the electronic rearview mirror. The obstacle information may include: enlarging the obstacle view, displaying the distance of the rear vehicle, the obstacle distance, the pedestrian distance, etc., and obstacle reminders can also be provided using voice warnings and other prompts.

[0071] For example, the vehicle radar and the external camera are used to sense the distance to obtain obstacle information W-15 and Z-125, where W-15 is an obstacle in the vehicle's driving route and meets the requirement of an obstacle that affects driving safety, and Z-125 is an obstacle outside the vehicle's driving route and does not meet the requirement of an obstacle that affects driving safety. In this case, information such as the distance between obstacle W-15 and the vehicle is displayed on the electronic rearview mirror, and a voice warning is given.

[0072] In some embodiments, if the current vehicle speed value is greater than or equal to a preset vehicle speed threshold, the information to be displayed in the vehicle rearview mirror corresponding to the far-angle viewing angle in the visual range is obtained.

[0073] Optionally, the range displayed by the electronic rearview mirror is a dynamic area captured by the camera. The viewing angle of the image captured by the camera can be adjusted. If the current vehicle speed value is greater than or equal to the preset vehicle speed threshold, a farther viewing angle can be displayed, which is convenient for the driver to observe the vehicle information farther away and obtain more information. Among them, the camera supports the electronic zoom function, which can switch the images at far and near through electronic focus to present a larger or farther viewing angle.

[0074] If the current vehicle speed value is less than the preset vehicle speed threshold, the information to be displayed by the vehicle rearview mirror corresponding to the near-angle viewing angle of the visual range is obtained.

[0075] Specifically, if the current vehicle speed is less than the preset speed threshold, the electronic rearview mirror can display information around the vehicle to help the driver obtain more comprehensive information. The automatic adjustment of the display angle according to the vehicle speed can give the driver a better driving experience during driving.

[0076] Step 205: acquiring information to be displayed on the vehicle rearview mirror at a corresponding viewing angle according to the visual range.

[0077] Exemplarily, when obtaining the information to be displayed in the vehicle rearview mirror of the corresponding viewing angle according to the visual range, the following method can be used but is not limited to it, and the method includes: obtaining the information to be displayed in the vehicle rearview mirror of the corresponding viewing angle according to the visual range by pre-stored in the in-vehicle computing computer.

[0078] Step 206: Display the information to be displayed in the vehicle rearview mirror in the electronic rearview mirror.

[0079] Figure 5 A schematic diagram of an example structure that can be used to implement an embodiment of the present disclosure is shown.

[0080] The overall structure of this embodiment includes: an external camera, an internal camera, a high-speed bus, an internal display, a high-definition digital display interface standard (DisplayPort, DP) interface, a vehicle host, and a sensing unit. The driver's facial image is obtained in real time through the internal camera, and the driver's facial image is output to the vehicle host in real time. The vehicle host determines the information to be displayed on the vehicle rearview mirror based on the driver's facial image and the vehicle status information obtained by the sensing unit, and then uses the external camera to obtain the information to be displayed on the vehicle rearview mirror through the high-speed bus, and adjusts the information to be transmitted to the vehicle host in real time. The vehicle host will obtain the information to be displayed on the vehicle rearview mirror through the DP interface on the in-vehicle display screen.

[0081] According to this embodiment, the vehicle host can flexibly display the electronic rearview mirror based on the perception of the driver's field of vision and in combination with vehicle conditions such as vehicle speed and turning, so the user is no longer required to operate and set on the screen, thereby improving the convenience of using the electronic rearview mirror and further improving the user experience.

[0082] Corresponding to the above-mentioned image display method of the electronic rearview mirror, the present invention further provides an image display device for the electronic rearview mirror. Since the device embodiment of the present invention corresponds to the above-mentioned method embodiment, the details not disclosed in the device embodiment can be referred to the above-mentioned method embodiment, and will not be described in detail in the present invention.

[0083] Figure 6 A schematic diagram of the structure of an image display device for an electronic rearview mirror provided in an embodiment of the present disclosure, such as Figure 6 As shown, the device comprises:

[0084] A first acquisition module 301 is configured to acquire a facial image of a driver;

[0085] A determination module 302 is configured to analyze the facial image to determine the driver's sight range;

[0086] A second acquisition module 303 is configured to acquire the to-be-displayed information of the vehicle rearview mirror at a corresponding viewing angle according to the visual range;

[0087] The display module 304 is configured to display the information to be displayed in the vehicle rearview mirror in the electronic rearview mirror.

[0088] In some embodiments, the determination module 302 is configured to analyze the facial image to extract key features of line of sight movement; determine whether the driver's line of sight has moved based on the key features; if the driver's line of sight has moved, determine the driver's line of sight range based on the key feature reference point and the movement information of the key features.

[0089] In some embodiments, the determination module 302 is configured to determine the driver's sight range according to key feature reference points and the direction and distance of the movement based on visual perception technology.

[0090] In some embodiments, the determination module 302 is configured to determine the driver's line of sight based on the key feature reference points and the direction and distance of the driver's facial movement based on the visual perception technology if the driver's face moves but the eye pupil does not move; if the driver's face does not move but the eye pupil moves, the driver's line of sight is determined based on the key feature reference points and the direction and distance of the driver's eye pupil movement based on the visual perception technology; if the driver's face and eye pupil move, the driver's line of sight is determined based on the visual perception technology based on the key feature reference points and the direction and distance of the driver's face and eye pupil movement.

[0091] In some embodiments, the first acquisition module 301 is configured to acquire the status information of the vehicle; the second acquisition module 303 includes: acquiring the to-be-displayed information of the vehicle rearview mirror at a corresponding viewing angle according to the visual range and the vehicle status information.

[0092] In some embodiments, the second acquisition module 303 is configured to obtain the information to be displayed in the vehicle rearview mirror of the far-angle view corresponding to the visual range if the current vehicle speed value is greater than or equal to the preset vehicle speed threshold; if the current vehicle speed value is less than the preset vehicle speed threshold, then obtain the information to be displayed in the vehicle rearview mirror of the near-angle view corresponding to the visual range.

[0093] In some embodiments, the second acquisition module 303 is configured to determine whether the current driving is safe based on the vehicle condition information around the vehicle; when it is determined that the current driving is not safe, obtain the corresponding near-angle vehicle rearview mirror information to be displayed.

[0094] It should be noted that the above explanation of the method embodiment is also applicable to the device of this embodiment, and the principle is the same, which is not limited in this embodiment.

[0095] According to an embodiment of the present disclosure, the present disclosure also provides a vehicle, including: Figure 6 An image display device of an electronic rearview mirror is shown.

[0096] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium and a computer program product.

[0097] Electronic devices are intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframes, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0098] Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, FPGAs (Field Programmable Gate Arrays), ASICs (Application-Specific Integrated Circuits), ASSPs (Application Specific Standard Products), SOCs (System On Chips), CPLDs (Complex Programmable Logic Devices), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include: being implemented in one or more computer programs that may be executed and / or interpreted on a programmable system including at least one programmable processor that may be a dedicated or general-purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0099] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0100] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any suitable combination of the foregoing. More specific examples of machine-readable storage media may include electrical connections based on one or more lines, portable computer disks, hard disks, RAM, ROM, EPROM (Electrically Programmable Read-Only-Memory) or flash memory, optical fiber, CD-ROM (Compact Disc Read-Only Memory), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0101] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (Cathode-Ray Tube) or LCD (Liquid Crystal Display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0102] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: LAN (Local Area Network), WAN (Wide Area Network), the Internet, and blockchain networks.

[0103] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services ("Virtual Private Server", or "VPS" for short). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0104] It should be noted that artificial intelligence is a discipline that studies how computers can simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), and includes both hardware-level and software-level technologies. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, and big data processing; artificial intelligence software technologies mainly include computer vision technology, speech recognition technology, natural language processing technology, as well as machine learning / deep learning, big data processing technology, knowledge graph technology, and other major directions.

[0105] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.

[0106] The above specific implementations do not constitute a limitation on the protection scope of the present disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. An image display method for an electronic rearview mirror, characterized in that: include: Obtaining a facial image of the driver; Analyzing the facial image to determine the driver's line of sight; Acquire the vehicle rearview mirror information to be displayed at a corresponding viewing angle according to the visual range; The information to be displayed in the vehicle rearview mirror is displayed in the electronic rearview mirror.

2. The method according to claim 1, characterized in that The step of analyzing the facial image to determine the driver's line of sight includes: Analyze the facial image to extract key features of line of sight movement; determining whether the driver's sight line moves according to the key feature; If the driver's line of sight moves, the driver's line of sight is determined according to the key feature reference point and the movement information of the key feature.

3. The method according to claim 2, characterized in that The movement information includes the direction and distance of movement, and the determining the driver's sight range according to the key feature reference point and the movement information of the key feature includes: Based on visual perception technology, the driver's field of vision is determined according to key feature reference points and the direction and distance of movement.

4. The method according to claim 3, characterized in that The key features include face and / or eye pupils, and the analysis based on the key feature reference points and the direction and distance of the movement to determine the driver's line of sight includes: If the driver's face moves but the pupil does not move, the driver's sight range is determined based on the visual perception technology according to the key feature reference points and the direction and distance of the driver's face movement; If the driver's face does not move but the eye pupil does move, the driver's line of sight is determined based on the visual perception technology according to the key feature reference point and the direction and distance of movement of the driver's eye pupil; If the driver's face and eye pupil move, the driver's field of vision is determined based on the visual perception technology according to the key feature reference points and the direction and distance of movement of the driver's face and eye pupil.

5. The method according to any one of claims 1 to 4, characterized in that After analyzing the facial image to determine the driver's line of sight, the method further includes: Acquiring status information of the vehicle; The vehicle rearview mirror information to be displayed at a corresponding viewing angle is obtained according to the visual range and the vehicle status information.

6. The method according to claim 5, characterized in that The vehicle state information includes vehicle speed, and the vehicle rearview mirror information to be displayed at a corresponding viewing angle obtained according to the visual range and the vehicle state information includes: If the current vehicle speed value is greater than or equal to the preset vehicle speed threshold, obtaining the information to be displayed in the vehicle rearview mirror of the telescopic viewing angle corresponding to the visual range; If the current vehicle speed value is less than the preset vehicle speed threshold, the information to be displayed by the vehicle rearview mirror corresponding to the near-angle viewing angle of the visual range is obtained.

7. An image display device for an electronic rearview mirror, characterized in that: include: A first acquisition module is configured to acquire a facial image of the driver; a determination module, configured to analyze the facial image to determine the driver's sight range; A second acquisition module is configured to acquire the to-be-displayed information of the vehicle rearview mirror at a corresponding viewing angle according to the visual range; The display module is configured to display the information to be displayed by the vehicle rearview mirror in the electronic rearview mirror.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

9. An electronic device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 6 is implemented.

10. A vehicle, characterized in that: include: The electronic device as claimed in claim 9.

Images