Inner rear-view mirror adjusting method and device, electronic equipment and storage medium
By automatically identifying and adjusting the rotation angle of the inner rearview mirror, the driver's distraction caused by manual adjustment and the high cost of streaming inner rearview mirrors is solved, and the more efficient and safer observation effect of the inner rearview mirror is achieved.
Patent Information
- Application Number
- CN202411137528.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-19
- Publication Date
- 2024-11-08
AI Technical Summary
The existing inner rearview mirror adjustment method relies on manual operation, which causes the driver to be distracted and unable to follow the driver's posture changes. The streaming inner rearview mirror is costly and practical, and cannot meet the needs of different drivers.
By obtaining the user image of the target user in the vehicle, performing human eye tracking and head posture recognition, determining the target human eye position and tilt angle, calculating the target rotation angle of the inner rearview mirror, and automatically adjusting to adapt to the driver's Changes in sight.
Automatic adjustment of the inner rearview mirror is realized, which improves the convenience and accuracy of observing the rear of the vehicle, avoids distraction caused by adjustment of the inner rearview mirror during driving, improves driving safety, and reduces hardware equipment. cost and complexity.
Smart Images

Figure CN118906967A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle control technology, and in particular to an interior rearview mirror adjustment method, device, electronic device and storage medium. Background Art
[0002] The automobile driving assistance system is a system designed to improve driving safety and comfort, in which the adjustment of the rearview mirror is an important part. The rearview mirror can help the driver observe the traffic conditions behind and make correct driving decisions. However, due to differences in factors such as driver height and sitting posture, as well as the complexity of the road environment, the existing rearview mirror adjustment cannot meet the usage needs.
[0003] In related technologies, the adjustment of the rearview mirror mainly depends on the manual operation of the driver. The driver can adjust the angle of the rearview mirror mechanically or electrically to achieve the best observation effect. In addition, some high-end models have begun to use streaming media rearview mirrors, which can obtain the image behind the vehicle through the camera and then display it to the driver through the display screen, thereby improving the convenience and accuracy of observation.
[0004] Although the above-mentioned rearview mirror adjustment method solves the problem of observing rear traffic to a certain extent, there are still some problems and shortcomings. First, the manual adjustment method causes the driver to be distracted during driving, which may affect driving safety. Secondly, since the driver may change his posture during driving, manual adjustment cannot follow the driver's posture changes. In addition, the cost of streaming media rearview mirrors is high, and the requirements for hardware equipment are also high, and its practicality and universality are not high. Obviously, there is an urgent need for a new rearview mirror adjustment method to solve at least one of the above problems.
[0005] It should be noted that the above content only provides background technical information related to the present application and does not necessarily constitute prior art. Summary of the invention
[0006] In view of the shortcomings of the prior art mentioned above, the present application provides a method, device, electronic device and storage medium for adjusting the interior rearview mirror to achieve automatic adjustment of the interior rearview mirror, improve the convenience and accuracy of observing the situation behind the vehicle, avoid distraction caused by adjusting the interior rearview mirror during driving, and thus improve driving safety.
[0007] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.
[0008] According to one aspect of an embodiment of the present application, a method for adjusting an interior rearview mirror is provided, comprising: acquiring a user image of a target user in a vehicle, the user image including information on the position of both eyes and head posture of the target user; performing eye tracking and head posture recognition on the user image respectively to obtain a target eye position and a target head tilt angle; determining a target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, performing a conversion calculation based on the target position to obtain a target rotation angle of the interior rearview mirror, the target position being a middle area of the interior rearview mirror; and adjusting the rotation angle of the interior rearview mirror based on the target rotation angle.
[0009] In one embodiment of the present application, based on the aforementioned scheme, a target rotation angle of the rearview mirror is obtained by performing a conversion calculation based on the target position, including: identifying the posture information of the target user in the user image, and determining the target user position representing the upper body position of the target user; constructing a visual field model with the target eye position as the perspective based on the upper body position of the target user and the target head tilt angle, and determining the target visual field range of the target user according to the relative orientation between the visual field model and the rearview mirror; performing eye tracking and identification on the target eye position, and determining the target user's area of interest within the target visual field range; adjusting the current area of interest to the middle area of the rearview mirror to obtain the image migration orientation; and determining the target rotation angle of the rearview mirror to be adjusted by performing coordinate transformation on the image migration orientation.
[0010] In one embodiment of the present application, based on the aforementioned scheme, after obtaining the user image of the target user in the vehicle, the method further includes: performing face recognition on the user image to obtain a face recognition result; matching the face recognition result with historical face data; if the match is successful, adjusting the interior rearview mirror according to the rotation angle corresponding to the matched historical face data; if the match fails, obtaining the user image of the target user.
[0011] In one embodiment of the present application, based on the aforementioned scheme, after determining the target position in a preset reference coordinate system according to the target human eye position and the target head tilt angle, the method further includes: obtaining the current center position of the rearview mirror; calculating the target center position of the rearview mirror after adjustment based on the target position and the current center position, wherein the target center position coincides with at least a portion of the target position; and obtaining the target rotation angle of the rearview mirror by converting and calculating the target center position and the current center position.
[0012] In one embodiment of the present application, based on the aforementioned scheme, the method further includes: tracking the positions of key points of the user image, the key points including the user's head and the user's eyes, calculating the position change values of the key points according to the positions of the key points at the current moment and the key points at the previous moment; if it is determined that the preset requirement conditions are met, the position change value is greater than a preset change threshold, and the duration is greater than a first preset time, then reacquiring the user image of the target user to re-determine the target rotation angle to adjust the rearview mirror; if it is determined that the preset requirement conditions are not met, and the position change value is greater than the preset change threshold, the rearview mirror is not adjusted.
[0013] In one embodiment of the present application, based on the aforementioned scheme, if it is determined that the preset requirement conditions are met, the rotation angle of the interior rearview mirror is adjusted based on the target rotation angle; the preset requirement conditions are determined to be met by at least one of the following methods: comparing the target position with a preset position range, and if the target position is within the preset position range, then it is determined that the preset requirement conditions are met; obtaining current vehicle information, and if the current vehicle information meets the preset vehicle information, then it is determined that the preset requirement conditions are met, wherein the current vehicle information includes the vehicle's driving intention and the distance between the front and rear vehicles.
[0014] In one embodiment of the present application, based on the aforementioned scheme, the preset vehicle information includes: the vehicle is in at least one of a reversing state, a lane changing state, an overtaking state and an emergency state, and / or the distance between the front and rear vehicles is less than a preset distance threshold, wherein the emergency state includes at least one of the front vehicle braking within a second preset time and a traffic accident occurring ahead.
[0015] According to one aspect of an embodiment of the present application, a rearview mirror adjustment device is provided, comprising: an acquisition module, used to acquire a user image of a target user in a vehicle, the user image including information on the position of both eyes and the head posture of the target user; an identification module, used to perform eye tracking and head posture identification on the user image, respectively, to obtain a target eye position and a target head tilt angle; a calculation module, used to determine a target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, and to obtain a target rotation angle of the rearview mirror by performing a conversion calculation based on the target position, the target position being the middle area of the rearview mirror; and an adjustment module, used to adjust the rotation angle of the rearview mirror based on the target rotation angle.
[0016] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the electronic device implements a rearview mirror adjustment method as described in any one of the above embodiments.
[0017] The present application also provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor of a computer, the computer is enabled to execute the rearview mirror adjustment method as described in any one of the above embodiments.
[0018] Beneficial effects of the present application: The present application obtains a user image of a target user in a vehicle, wherein the user image includes information on the position of both eyes and the posture of the head of the target user, performs eye tracking and head posture recognition on the user image, respectively, obtains the target eye position and the target head tilt angle, determines the target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, obtains the target rotation angle of the interior rearview mirror by performing conversion calculation based on the target position, and solves the problem of a line of sight angle change caused by a change in the eye position, i.e., the head tilt angle, due to factors such as the height and sitting posture of the target user, thereby avoiding the interior rearview mirror being unsuitable for variable factors such as the height and sitting posture of the user; adjusts the rotation angle of the interior rearview mirror based on the target rotation angle; and realizes automatic adjustment of the interior rearview mirror through the above method, thereby improving the convenience and accuracy of observing the situation behind the vehicle, avoiding distraction caused by adjusting the interior rearview mirror during driving, and thereby improving driving safety.
[0019] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the drawings:
[0021] Figure 1 is a schematic diagram of an exemplary system architecture shown in an exemplary embodiment of the present application;
[0022] Figure 2 is a flow chart of a method for adjusting an interior rearview mirror according to an exemplary embodiment of the present application;
[0023] Figure 3is a block diagram of an interior rearview mirror adjustment system shown in an exemplary embodiment of the present application;
[0024] Figure 4 is a block diagram of an interior rearview mirror adjustment device shown in an exemplary embodiment of the present application;
[0025] Figure 5 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION
[0026] The following will describe the implementation methods of the present application with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present application from the contents disclosed in this specification. The present application can also be implemented or applied through other different specific implementation methods, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present application. It should be understood that the preferred embodiments are only for illustrating the present application, not for limiting the scope of protection of the present application.
[0027] It should be noted that the illustrations provided in the following embodiments are only used to illustrate the basic concept of the present application in a schematic manner, and therefore the illustrations only show components related to the present application rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.
[0028] In the following description, a large number of details are discussed to provide a more thorough explanation of the embodiments of the present application. However, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present application difficult to understand.
[0029] First of all, it should be noted that when the vehicle is driving, the rearview mirror can play an important role in many situations. The following are several specific scenarios: 1. Judging the distance between vehicles. Keeping a proper distance from other vehicles when the car is driving is the key to reducing traffic accidents. Sometimes the exterior rearview mirror may not be able to clearly show the distance of the vehicle behind, but the interior rearview mirror can provide a clearer view to help the driver judge the distance from the rear vehicle more accurately. 2. Steering assistance. When preparing to overtake or change lanes, the driver usually turns on the turn signal first, and then observes the situation of the vehicle behind through the rearview mirror. The rearview mirror can provide a wider field of view to help the driver confirm whether there is a vehicle approaching from behind or whether there is an intention to change lanes, so as to complete the overtaking or lane change safely. 3. Emergency braking. When there is an emergency in front and an emergency brake is required, the driver can quickly observe whether there is a vehicle following closely behind through the rearview mirror. According to the distance to the vehicle in front and the situation of the vehicle behind, the driver can appropriately relax the brakes or consider changing lanes to leave enough braking distance and space for the vehicle behind, so as to effectively avoid the occurrence of rear-end collisions. 4. Observe the rear passengers. The driver can observe the rear passengers through the rearview mirror, especially when there are children in the back seat. This way of observation does not require the driver to turn his head, which reduces safety hazards and ensures timely attention and care for the rear passengers. 5. Reduce the blind spot of vision. During the driving process of the vehicle, due to the limitations of the body structure and the rearview mirror design, the driver's vision will have certain blind spots. Through the rational use of the rearview mirror, the scope of these blind spots can be reduced, and the driver's perception of the surrounding environment can be improved, thereby enhancing driving safety. In summary, when the vehicle is driving, the rearview mirror is needed to judge the distance between vehicles, steering assistance, emergency braking, observe the rear passengers, and reduce the blind spot of vision. The driver can improve driving safety and driving experience by making full use of the rearview mirror.
[0030] Eye tracking algorithm is a technology used to detect and track the position and movement of human eyes. It involves multiple disciplines such as image processing, computer vision, pattern recognition, and cognitive psychology. The basic principle of eye tracking algorithm is usually based on image processing technology. By locating the pupil position and obtaining its coordinates, a certain algorithm is used to calculate the point where the eye is looking or gazing. This technology enables the computer to know where the user is looking, when he is looking, and the possible reasons.
[0031] The eye tracking algorithm based on deep learning has been a research hotspot in the field of computer vision in recent years. It uses the powerful feature extraction and learning capabilities of the deep learning model to accurately track the position of the human eye and estimate the gaze point.
[0032] Figure 1 It is a schematic diagram of an exemplary system architecture shown in an exemplary embodiment of the present application.
[0033] Reference Figure 1As shown, the system architecture may include an image acquisition device 101 and a computer device 102. The computer device 102 may be at least one of a desktop graphics processing unit (GPU) computer, a GPU computing cluster, a neural network computer, etc. The image acquisition device 101 is used to acquire a user image of a target user in a vehicle. In this embodiment, the image acquisition device 101 acquires the above image and provides it to the computer device 102 for processing. Relevant technicians can use the computer device 102 to perform eye tracking and head posture recognition on the user image, obtain the target eye position and the target head tilt angle, determine the target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, convert and calculate based on the target position to obtain the target rotation angle of the inner rearview mirror, wherein the target position is the middle area of the inner rearview mirror, and adjust the rotation angle of the inner rearview mirror based on the target rotation angle. It should be noted that the image acquisition device 101 and the computer device 102 provided in this embodiment are only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0034] It should be noted that the rearview mirror adjustment method provided in the embodiment of the present application is generally executed by the computer device 102 , and accordingly, the rearview mirror adjustment device is generally arranged in the computer device 102 .
[0035] Figure 2 is a flow chart of an exemplary embodiment of the present invention showing a method for adjusting an inner rearview mirror. The method for adjusting an inner rearview mirror can be executed by a computing and processing device. The computing and processing device can be Figure 1 The computer device 102 shown in FIG. Figure 2 As shown, the rearview mirror adjustment method at least includes steps S210 to S240, which are described in detail as follows:
[0036] In step S210 , a user image of a target user in a vehicle is acquired.
[0037] In one embodiment of the present application, after the target user gets on the vehicle, the user image of the target user in the vehicle is obtained through the image acquisition device in the vehicle, wherein the image acquisition device includes but is not limited to a camera, etc., and the camera includes but is not limited to a surveillance camera, an infrared camera, etc., and the user image includes the position of both eyes and the head posture information of the target user. The collected user image is preprocessed, and the preprocessing includes operations such as denoising and contrast enhancement to improve the accuracy of processing such as image recognition.
[0038] In one embodiment of the present application, after obtaining a user image of a target user in a vehicle, face recognition is performed on the user image to obtain a face recognition result; the face recognition result is matched with historical face data; if the match is successful, the interior rearview mirror is adjusted according to the rotation angle corresponding to the matched historical face data; if the match fails, the user image of the target user is obtained, and after adjusting the interior rearview mirror, the target rotation angle is recorded and stored.
[0039] In this embodiment, the interior rearview mirror is adjusted according to the rotation angle corresponding to the matched historical facial data, including at least one of the following: sorting the matched historical facial data in chronological order, determining the rotation angle corresponding to the historical facial data closest to the current time as the target rotation angle, and adjusting the interior rearview mirror according to the target rotation angle; calculating the average value of the matched historical facial data, determining the calculated average rotation angle as the target rotation angle, and adjusting the interior rearview mirror according to the target rotation angle.
[0040] In step S220, eye tracking and head posture recognition are performed on the user image to obtain the target eye position and target head tilt angle.
[0041] In one embodiment of the present application, eye tracking and recognition is performed on the user image through an eye tracking algorithm based on deep learning to obtain the target eye position, and head posture recognition is performed on the user image to obtain the target head tilt angle.
[0042] In step S230, the target position in a preset reference coordinate system is determined according to the target eye position and the target head tilt angle, and a conversion calculation is performed based on the target position to obtain a target rotation angle of the rearview mirror.
[0043] In one embodiment of the present application, the posture information of the target user in the user image is identified to determine the target user position representing the upper body position of the target user; a field of view model with the target eye position as the perspective is constructed based on the upper body position of the target user and the target head tilt angle, and the target field of view of the target user is determined according to the relative orientation between the field of view model and the rearview mirror; eye tracking is performed on the target eye position to determine the target user's area of interest within the target field of view; the current area of interest is adjusted to the middle area of the rearview mirror to obtain the image migration orientation; and the target rotation angle of the rearview mirror to be adjusted is determined by performing coordinate transformation on the image migration orientation.
[0044] In this embodiment, a deep learning algorithm (such as a convolutional neural network) is used to process the collected user image, identify the target user position representing the upper body position of the target user, and convert it to a preset reference coordinate system. A visual field model with the target eye position as the perspective is constructed based on the upper body position of the target user and the target head tilt angle. For ease of understanding, the visual field model can be regarded as a three-dimensional visual field model, which takes the target eye position as the vertex of the cone. Determining the target visual field range of the target user according to the relative orientation between the visual field model and the rearview mirror may include the following steps: determining the vertex position of the visual field model according to the target eye position, and determining the target visual field range of the target user based on the vertex position of the visual field model and the position of the rearview mirror. Using an image processing algorithm to identify the characteristic points of the eye, such as the pupil, the eyeball, etc., based on the position change of the characteristic points, the eyeball movement trajectory and the gaze point data are calculated, and the eyeball position information is updated; according to the eyeball movement trajectory and the gaze point data, the target user's area of interest within the target visual field is analyzed. Through image processing technology, the area of interest is adjusted to the middle area of the rearview mirror display interface to ensure that the target user can see the information of the area of interest when the line of sight is naturally focused. Record the migration direction and distance of the image from the original position of the area of interest to the middle area of the inner rearview mirror, and convert it into the corresponding angle and displacement, that is, the image migration direction. Convert the image migration direction from the image coordinate system to the mechanical control coordinate system of the rearview mirror. Based on the result after the coordinate conversion, combined with the mechanical characteristics of the rearview mirror (such as rotation range, accuracy, etc.), calculate the target rotation angle that the inner rearview mirror needs to be adjusted. Send the calculated target rotation angle to the rearview mirror control module, and drive the rearview mirror motor to perform the corresponding rotation operation until it reaches the predetermined position. Preferably, the user image is captured again by the image acquisition device to verify whether the adjusted field of view of the inner rearview mirror meets the expected requirements, and make fine adjustments if necessary. It should be noted that this embodiment is only for illustrative purposes and does not limit the present application, nor should it bring any limitations to the functions and scope of use of the embodiments of the present application.
[0045] It should be noted that the user data such as user images obtained in the embodiments of the present application are obtained with the user, or are actively submitted after the user's relevant instructions, or are necessarily uploaded when the user uses the corresponding application through the client, web page, etc. In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision, disclosure and application of the user's personal information involved are in compliance with the provisions of relevant laws and regulations, necessary confidentiality measures are taken, and do not violate public order and good customs.
[0046] In one embodiment of the present application, the target rotation angle of the interior rearview mirror can be obtained by conversion calculation based on the target position and the target visual range; the target visual range can also be calculated by at least one of the following methods: performing image recognition on the user image through a preset visual range calculation model to obtain the target visual range of the target user, wherein the visual range calculation model is trained based on image samples with user visual range labels; performing image recognition on the user image to obtain the target user position of the target user, and calculating based on the target user position, the target eye position and the target head tilt angle to obtain the target visual range of the target user. The target position is the middle area of the interior rearview mirror.
[0047] In this embodiment, image samples and sample user field of view are obtained; the image samples are labeled according to the sample user field of view to generate image samples with user field of view labels; and a preset field of view calculation model is trained based on the image samples with user field of view labels to obtain a preset field of view calculation model.
[0048] In this embodiment, sample user positions, sample eye positions, sample head tilt angles and sample visual fields of multiple sample users are obtained, and a mapping relationship among the sample user positions, sample eye positions, sample head tilt angles and sample visual fields is established based on the sample user positions, sample eye positions, sample head tilt angles and sample visual fields of each sample user. According to the target user position, target eye position and target head tilt angle of the target user and the mapping relationship, the target visual field is calculated.
[0049] In one embodiment of the present application, after determining the target position in a preset reference coordinate system based on the target human eye position and the target head tilt angle, the current center position of the rearview mirror is obtained; the target center position of the rearview mirror after adjustment is calculated based on the target position and the current center position, wherein the target center position coincides with at least a portion of the target position; and the target rotation angle of the rearview mirror is obtained by converting and calculating the target center position and the current center position.
[0050] In this embodiment, after the target center position of the rearview mirror after adjustment is calculated based on the target position and the current center position, the target rotation angle is calculated based on the current center position and the target center position, the current rotation angle of the rearview mirror is obtained, and the target rotation angle is adjusted based on the current rotation angle. The rearview mirror can be controlled to adjust the target rotation angle, and the rearview mirror can also be adjusted based on the target rotation angle, so that the target user can view the rear of the vehicle from the rearview mirror.
[0051] In one embodiment of the present application, the position of key points of the user image is tracked, the key points include the user's head and the user's eyes, and the position change value of the key point is calculated based on the key point position at the current moment and the key point position at the previous moment; if it is determined that the preset requirement conditions are met, that is, the target user needs to check the rearview mirror, the position change value is greater than the preset change threshold, and the duration is greater than the first preset time, then the user image of the target user is re-acquired to re-determine the target rotation angle to adjust the rearview mirror; if it is determined that the preset requirement conditions are not met, that is, the target user does not need to check the rearview mirror, and the position change value is greater than the preset change threshold, the rearview mirror is not adjusted.
[0052] In this embodiment, after the user image is captured by the main driving camera in the vehicle (such as the DMS driver monitoring system), key points of the user image are detected, extracted, described and matched, and the positions of the user's head, eyes and / or sitting posture in the image are tracked and identified; the changes in pixel values between the previous and next frames of the image are compared to determine the position change value of the user's head, eyes and / or sitting posture. If the position change value is greater than a preset change threshold and the duration is greater than a first preset time, the user's sitting posture, eye position and the corresponding appropriate rearview mirror adjustment position are relocated and recorded; during driving, if the target user does not tilt his head to observe the rearview mirror, or there is no need to use the rearview mirror, then when the position change value of the user's head, eyes and / or sitting posture is greater than the preset change threshold, only the target value of the rearview mirror to be adjusted is recorded without performing an adjustment action on the rearview mirror, thereby achieving a technical effect of not performing rearview mirror adjustment unnecessarily to deprive the driver of his attention and affect the driver's driving.
[0053] In step S240 , the rotation angle of the interior rearview mirror is adjusted based on the target rotation angle.
[0054] In one embodiment of the present application, if it is determined that the preset requirement condition is met, that is, the target user needs to check the rearview mirror, the rotation angle of the rearview mirror is adjusted based on the target rotation angle; the preset requirement condition is determined to be met by at least one of the following methods: comparing the target position with the preset position range, if the target position is within the preset position range, then it is determined that the preset requirement condition is met; obtaining the current vehicle information, if the current vehicle information meets the preset vehicle information, then it is determined that the preset requirement condition is met, wherein the current vehicle information includes the vehicle's driving intention and the distance between the front and rear vehicles.
[0055] In this embodiment, the target position is compared with the preset position range, and if the target position is within the preset position range, it is determined that the target user needs to check the rearview mirror. For example, if the target position is within the range of the rearview mirror, it is determined that the target user needs to check the rearview mirror.
[0056] In one embodiment of the present application, the preset vehicle information includes: the vehicle is in at least one of a reversing state, a lane changing state, an overtaking state and an emergency state, and / or the distance between the front and rear vehicles is less than a preset distance threshold, wherein the emergency state includes at least one of the front vehicle braking within a second preset time and a traffic accident occurring ahead.
[0057] In this embodiment, the ADAS system or the camera and sensor outside the vehicle are used to determine the demand for the interior rearview mirror, including the target vehicle's driving intention, the distance from the rear vehicle, etc. The above-mentioned driver's demand for the interior rearview mirror, that is, the target user's need to check the interior rearview mirror, includes: when the vehicle is in a reversing state, it is necessary to observe the situation behind through the rearview mirror, judge the distance and angle, and ensure safe reversing; when the vehicle is in a lane changing state, it is necessary to observe the position and speed of the rear vehicle through the rearview mirror when changing lanes to ensure safe lane changing; when the vehicle is in an overtaking state, it is necessary to observe the position and speed of the vehicle in front through the rearview mirror when overtaking, and observe the situation of the vehicle behind at the same time; when the vehicle is in an emergency, such as when the vehicle in front suddenly brakes or an accident occurs, it is necessary to observe the situation of the vehicle behind through the rearview mirror so as to take timely response measures.
[0058] In one embodiment of the present application, if it is determined that the target user needs to check the rearview mirror, a prompt message is generated, and the target user is prompted to check the rearview mirror and pay attention to the driving conditions behind.
[0059] In this embodiment, when the driver needs to observe the rearview mirror, the motor module adjusts the angle of the rearview mirror according to the current driver's sitting posture, eye position, etc. and issues a prompt sound, reminding the driver to pay attention to the driving environment behind the rearview mirror.
[0060] In one embodiment of the present application, if the driver's field of view needs to be accurately customized and calibrated, without the installation of complex instruments such as optometry or eye detection, reverse calculation can be performed based on the driver's driving habits; for example, after fixing the angle of the rearview mirror, the driver's eye height, sitting position and head tilt angle during driving are obtained to calculate the field of view when the driver's eyes are in the front view. After the user gets on the car, the sitting position and eye position are obtained, and the user's field of view is estimated according to the above process; the first angle adjustment of the rearview mirror is performed based on empirical data such as field of view, sitting position, eye position, head tilt angle, etc.
[0061] In one embodiment of the present application, if it is detected that the current time is at night and it is detected that the rear vehicle has turned on the high beam, the position of the rearview mirror is automatically adjusted to reduce the light reflected to the eyes of the target user.
[0062] Figure 3FIG. 1 is a block diagram of an exemplary embodiment of the present application showing an interior rearview mirror adjustment system. Figure 3 As shown, in an exemplary embodiment, an image acquisition device is installed in the car, including but not limited to a camera, an eye tracking camera capable of eye tracking, such as a high-resolution infrared camera. Preferably, the frame rate of the camera is 30fps, the pixel is 1280*720, and the driver's eye image, i.e., the user image, can be clearly captured in a dark environment. The camera is connected to the vehicle's intelligent control system via a USB interface, and the captured eye image is transmitted to the intelligent control system in real time. The intelligent control system can be composed of a microprocessor with high-speed processing capability and related memory. Preferably, the main frequency of the microprocessor is 2.0GHz and the memory is 4GB. The intelligent control system runs an eye tracking algorithm based on deep learning, which can calculate the target eye position and target head tilt angle of the driver, i.e., the target user, in real time based on the eye image captured by the camera. The electric actuator can be composed of a stepper motor and a gear transmission mechanism. Preferably, the speed of the stepper motor is 5000rpm, the torque is 2.0N·m, and the reduction ratio of the gear transmission mechanism is 1:50. When the intelligent control system calculates the adjustment rotation angle of the rearview mirror that needs to be adjusted, it will send a corresponding control signal to the electric actuator, and the stepper motor will drive the gear transmission mechanism to rotate the rearview mirror to the target rotation angle. It should be noted that the above-mentioned devices are only preferred examples, and other devices that can achieve corresponding functions can be selected as substitutes. This application does not limit this, nor should it bring any limitations to the functions and scope of use of the embodiments of this application.
[0063] In this embodiment, cost factors are fully considered during the design and implementation process, and mature eye tracking cameras, microprocessors and stepper motors on the market are used to avoid adding too much cost. At the same time, standard industrial-grade components are used to ensure the stability and reliability of the system. The above components cooperate with each other to realize the automatic adjustment of the rearview mirror, improve driving safety, and meet the needs of different driving environments and drivers.
[0064] The present application determines whether the purpose of the driver turning his head is to look at the rearview mirror through the driver's eye position. If it is determined to be so, the rotation angle of the rearview mirror is adjusted according to the driver's head tilt angle and eye position, thereby realizing automatic adjustment of the rearview mirror, greatly reducing the time the driver is distracted during driving, reducing the driver's operating burden, and improving driving safety; compared with the manual adjustment method, the present application can more accurately meet the driver's observation needs, improve the convenience and accuracy of observation; compared with the streaming media rearview mirror, the present application does not require high-cost hardware equipment, reduces production costs, and is more suitable for more car models on the market; the automatic adjustment method of the present application can better adapt to the differences in factors such as different heights and sitting postures of different drivers, and has stronger adaptability.
[0065] Figure 4 is a block diagram of an exemplary embodiment of the present application showing an inner rearview mirror adjustment device. The device can be applied to Figure 1 The implementation environment shown in the figure is specifically configured in the computer device 102. The device can also be applied to other exemplary implementation environments and specifically configured in other devices. This embodiment does not limit the implementation environment to which the device is applied.
[0066] like Figure 4 As shown, the exemplary interior rearview mirror adjustment device includes: an acquisition module 410 , a recognition module 420 , a calculation module 430 and an adjustment module 440 .
[0067] Among them, the acquisition module 410 is used to acquire a user image of a target user in the vehicle, and the user image includes the eye position and head posture information of the target user; the recognition module 420 is used to perform eye tracking and head posture recognition on the user image respectively to obtain the target eye position and the target head tilt angle; the calculation module 430 is used to determine the target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, and obtain the target rotation angle of the rearview mirror by performing conversion calculation based on the target position, and the target position is the middle area of the rearview mirror; the adjustment module 440 is used to adjust the rotation angle of the rearview mirror based on the target rotation angle.
[0068] It should be noted that the rearview mirror adjustment device provided in the above embodiment and the rearview mirror adjustment method provided in the above embodiment belong to the same concept, wherein the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment, and will not be repeated here. In actual application, the rearview mirror adjustment device provided in the above embodiment can allocate the above functions to different functional modules as needed, that is, divide the internal structure of the device into different functional modules to complete all or part of the functions described above, and this is not limited here.
[0069] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by one or more processors, the electronic device implements the rearview mirror adjustment method provided in the above-mentioned embodiments.
[0070] Figure 5 The structure diagram of the computer system suitable for implementing the electronic device of the embodiment of the present application is shown. It should be noted that: Figure 5 The computer system 500 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.
[0071] like Figure 5 As shown, the computer system 500 includes a central processing unit (CPU) 501, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 502 or the program loaded from the storage part 508 to the random access memory (RAM) 503, such as executing the methods provided in the above-mentioned various embodiments. In the RAM 503, various programs and data required for system operation are also stored. The CPU 501, the ROM 502 and the RAM 503 are connected to each other through the bus 504. The input / output (I / O) interface 505 is also connected to the bus 504.
[0072] The following components are connected to the I / O interface 505: an input section 506 including a keyboard, a mouse, etc.; an output section 507 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker; a storage section 508 including a hard disk, etc.; and a communication section 509 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 509 performs communication processing via a network such as the Internet. A drive 510 is also connected to the I / O interface 505 as needed. A removable medium 511, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 510 as needed so that a computer program read therefrom is installed into the storage section 508 as needed.
[0073] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 509, and / or installed from a removable medium 511. When the computer program is executed by a central processing unit (CPU) 501, various functions defined in the system of the present application are executed.
[0074] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. A computer program contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.
[0075] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.
[0076] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.
[0077] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes the interior rearview mirror adjustment method provided in the above embodiments. The computer-readable storage medium may be included in the electronic device described in the above embodiments, or may exist independently without being assembled into the electronic device.
[0078] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.
[0079] Another aspect of the present application also provides a computer program product or a computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the rearview mirror adjustment method provided in each of the above embodiments.
[0080] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.
[0081] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.
[0082] The above embodiments are merely illustrative of the principles and effects of the present application, and are not intended to limit the present application. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present application. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed in the present application shall still be covered by the claims of the present application.
Claims
1. A method for adjusting an interior rearview mirror, characterized in that: include: Acquire a user image of a target user in a vehicle, wherein the user image includes eye position and head posture information of the target user; Performing eye tracking and head posture recognition on the user image to obtain a target eye position and a target head tilt angle; Determine a target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, and convert and calculate the target rotation angle of the inner rearview mirror based on the target position, wherein the target position is a middle area of the inner rearview mirror; The rotation angle of the interior rearview mirror is adjusted based on the target rotation angle.
2. The method for adjusting the rearview mirror according to claim 1, characterized in that: The target rotation angle of the interior rearview mirror is obtained by converting and calculating based on the target position, including: Recognize the posture information of the target user in the user image, and determine the target user position representing the upper body position of the target user; A visual field model with the target eye position as a viewing angle is constructed based on the upper body position of the target user and the target head tilt angle, and a target visual field range of the target user is determined according to the relative orientation between the visual field model and the rearview mirror; Perform eye tracking and identification on the target user's eye position to determine the target user's area of interest within the target visual field; Adjust the current region of interest to the middle area of the rearview mirror to obtain the image migration orientation; The target rotation angle of the interior rearview mirror to be adjusted is determined by performing coordinate transformation on the image migration orientation.
3. The method for adjusting an interior rearview mirror according to claim 1, characterized in that: After acquiring the user image of the target user in the vehicle, the method further includes: Performing face recognition on the user image to obtain a face recognition result; Matching the face recognition result with historical face data; If the match is successful, adjusting the interior rearview mirror according to the rotation angle corresponding to the matched historical face data; If the matching fails, the user image of the target user is obtained.
4. The method for adjusting an interior rearview mirror according to claim 1, characterized in that: After determining the target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, the method further includes: Obtaining the current center position of the interior rearview mirror; Calculating a target center position of the interior rearview mirror after adjustment based on the target position and the current center position, wherein the target center position coincides with at least a portion of the target position; The target rotation angle of the interior rearview mirror is obtained by converting and calculating according to the target center position and the current center position.
5. The method for adjusting an interior rearview mirror according to any one of claims 1 to 4, characterized in that: The method further comprises: Tracking the positions of key points of the user image, where the key points include the user's head and the user's eyes, and calculating the position change values of the key points based on the positions of the key points at a current moment and the positions of the key points at a previous moment; If it is determined that the preset requirement conditions are met, the position change value is greater than the preset change threshold, and the duration is greater than a first preset time, then reacquiring the user image of the target user to re-determine the target rotation angle to adjust the rearview mirror; If it is determined that the preset requirement condition is not met, and the position change value is greater than the preset change threshold, the interior rearview mirror is not adjusted.
6. The method for adjusting an interior rearview mirror according to any one of claims 1 to 4, characterized in that: If it is determined that the preset requirement condition is met, adjusting the rotation angle of the interior rearview mirror based on the target rotation angle; The preset requirement is determined to be met by at least one of the following methods: Comparing the target position with a preset position range, and if the target position is within the preset position range, determining that the preset requirement condition is met; The current vehicle information is obtained, and if the current vehicle information meets the preset vehicle information, it is determined that the preset requirement condition is met, wherein the current vehicle information includes the vehicle driving intention and the distance between the front and rear vehicles.
7. The method for adjusting an interior rearview mirror according to claim 6, characterized in that: The preset vehicle information includes: The vehicle is in at least one of a reversing state, a lane changing state, an overtaking state and an emergency state, and / or the distance between the front and rear vehicles is less than a preset distance threshold, wherein the emergency state includes at least one of the front vehicle braking within a second preset time and a traffic accident occurring ahead.
8. An interior rearview mirror adjustment device, characterized in that: include: An acquisition module, used to acquire a user image of a target user in a vehicle, wherein the user image includes information about the positions of both eyes and the posture of the head of the target user; A recognition module, used to perform eye tracking and head posture recognition on the user image to obtain a target eye position and a target head tilt angle; a calculation module, used to determine a target position in a preset reference coordinate system according to the target eye position and the target head tilt angle, and to convert and calculate the target rotation angle of the inner rearview mirror based on the target position, wherein the target position is a middle area of the inner rearview mirror; An adjustment module is used to adjust the rotation angle of the interior rearview mirror based on the target rotation angle.
9. An electronic device, characterized in that: The electronic device comprises: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the electronic device to implement the rearview mirror adjustment method as described in any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the rearview mirror adjustment method according to any one of claims 1 to 7.
Citation Information
Cited By
Adjusting method and device of rearview mirror, electronic equipment and readable storage medium
CN119705274A
