A rearview mirror adjustment method, device, system, and storage medium

Abstract

This application discloses a rearview mirror adjustment method, device, system, and storage medium. The method includes: acquiring a user's line of sight during vehicle movement; when the user's line of sight is located on the rearview mirror, determining a target point on the edge of the rearview mirror closest to the user's line of sight; when the distance between the target point and the line of sight is less than a first preset distance, acquiring the movement trend of the line of sight; when the movement trend of the line of sight is towards the target point, adjusting the angle of the rearview mirror to increase the user's field of vision within a preset area centered on the line of sight location. Using the solution provided in this application, automatic adjustment of the rearview mirror can be achieved, thereby improving driving convenience and safety.

Description

Technical Field

[0001] This application relates to the field of automotive technology, and in particular to a rearview mirror adjustment method, device, system, and storage medium. Background Technology

[0002] The exterior rearview mirrors, located on both sides of a car, are one of its essential components. Their primary function is to provide the driver with a view of the sides and rear of the vehicle. Currently, the mirror lenses are manually adjusted by the driver. Without manual adjustment, they remain stationary, resulting in a fixed and limited field of vision. Manually adjusting the mirror angle while the vehicle is in motion is not only inconvenient but also reduces driving safety.

[0003] Therefore, how to provide a rearview mirror adjustment method to automatically adjust the rearview mirror angle and improve driving convenience and safety has become an urgent technical problem to be solved. Summary of the Invention

[0004] This application provides a rearview mirror adjustment method, device, system, and storage medium to improve driving convenience and safety.

[0005] This application provides a rearview mirror adjustment method, including:

[0006] During vehicle movement, the user's line of sight is determined;

[0007] When the user's line of sight is on the vehicle's rearview mirror, determine the target point on the edge line of the rearview mirror that is closest to the user's line of sight.

[0008] When the distance between the target point and the point of view is less than a first preset distance, the movement trend of the point of view is obtained;

[0009] When the movement trend of the line of sight is towards the target point, the angle of the rearview mirror is adjusted to increase the user's field of vision within a preset area centered on the line of sight location.

[0010] The beneficial effects of this application are as follows: During vehicle movement, the user's line of sight is acquired; when the user's line of sight is on the rearview mirror, the target point closest to the user's line of sight is determined on the edge of the rearview mirror; when the distance between the user's line of sight and the target point is less than a first preset distance, the movement trend of the line of sight is acquired; when the movement trend of the line of sight is towards the target point, the angle of the rearview mirror is adjusted to increase the user's field of vision within a preset area centered on the line of sight position. Therefore, the angle of the vehicle's rearview mirror can be automatically adjusted according to the user's line of sight and its movement trend during vehicle movement, improving driving convenience and safety.

[0011] In one embodiment, obtaining the user's gaze point includes:

[0012] The user's eye movement data is obtained using an eye tracker;

[0013] The user's gaze point is determined based on the user's eye movement data.

[0014] In one embodiment, obtaining the user's gaze point includes:

[0015] The system acquires the user's eye movement data using an eye tracker, and also acquires the user's facial offset data and iris offset data using a camera.

[0016] The user's gaze point is determined based on the eye movement data, the user's facial offset data, and the user's iris offset data.

[0017] In one embodiment, determining the user's gaze point based on the eye-tracking data, the user's facial offset data, and the user's iris offset data includes:

[0018] The user's first gaze point is determined based on the eye movement data, and the user's second gaze point is determined based on the user's facial offset data and iris offset data.

[0019] Determine whether the distance between the first line of sight and the second line of sight is less than a second preset distance;

[0020] When the distance between the first line of sight and the second line of sight is less than the second preset distance, the first line of sight is determined to be the user's line of sight.

[0021] In one embodiment, the user's facial offset data includes a facial offset amount, and the user's iris offset data includes an iris offset amount. Determining the user's second gaze point based on the user's facial offset data and iris offset data includes:

[0022] The eye tracker obtains the point of gaze before the face and iris shift;

[0023] The user's second gaze point is determined based on the gaze point before the facial and iris offset, and the facial offset and / or iris offset.

[0024] In one embodiment, the method further includes:

[0025] When the distance between the first line of sight and the second line of sight is greater than the second preset distance, the center point of the line segment with the first line of sight and the second line of sight as endpoints is the user's line of sight.

[0026] In one embodiment, the user's facial offset data includes the user's facial offset direction, the user's iris offset data includes the user's iris offset direction, and obtaining the movement trend of the gaze point includes:

[0027] The movement trend of the gaze point is determined based on the user's facial offset direction and / or the user's iris offset direction.

[0028] In one embodiment, the method further includes:

[0029] When the movement trend of the line of sight does not approach the target point, it is determined that the rearview mirror angle does not need to be adjusted.

[0030] This application also provides a rearview mirror adjustment device, including:

[0031] The first acquisition module is used to acquire the user's line of sight during vehicle movement;

[0032] The determination module is used to determine the target point on the edge line of the rearview mirror that is closest to the user's line of sight when the user's line of sight is located on the vehicle's rearview mirror.

[0033] The second acquisition module is used to acquire the movement trend of the line of sight when the distance between the target point and the line of sight landing point is less than a first preset distance;

[0034] The adjustment module is used to adjust the angle of the rearview mirror when the movement trend of the line of sight is approaching the target point, so as to increase the user's field of vision within a preset area centered on the position of the line of sight.

[0035] In one embodiment, the first acquisition module includes:

[0036] The first acquisition submodule is used to acquire the user's eye movement data based on the eye tracker;

[0037] The first determining submodule is used to determine the user's gaze point based on the user's eye movement data.

[0038] In one embodiment, the first acquisition module includes:

[0039] The second acquisition submodule is used to acquire the user's eye movement data based on the eye tracker, and to acquire the user's facial offset data and iris offset data based on the camera.

[0040] The second determining submodule is used to determine the user's gaze point based on the eye movement data, the user's facial offset data, and the user's iris offset data.

[0041] In one embodiment, the second determining submodule is further configured to:

[0042] The user's first gaze point is determined based on the eye movement data, and the user's second gaze point is determined based on the user's facial offset data and iris offset data.

[0043] Determine whether the distance between the first line of sight and the second line of sight is less than a second preset distance;

[0044] When the distance between the first line of sight and the second line of sight is less than the second preset distance, the first line of sight is determined to be the user's line of sight.

[0045] In one embodiment, the user's facial offset data includes a facial offset amount, and the user's iris offset data includes an iris offset amount. Determining the user's second gaze point based on the user's facial offset data and iris offset data includes:

[0046] The eye tracker obtains the point of gaze before the face and iris shift;

[0047] The user's second gaze point is determined based on the gaze point before the facial and iris offset, and the facial offset and / or iris offset.

[0048] In one embodiment, the second determining submodule is further configured to:

[0049] When the distance between the first line of sight and the second line of sight is greater than the second preset distance, the center point of the line segment with the first line of sight and the second line of sight as endpoints is the user's line of sight.

[0050] In one embodiment, the user's facial offset data includes the user's facial offset direction, the user's iris offset data includes the user's iris offset direction, and obtaining the movement trend of the gaze point includes:

[0051] The movement trend of the gaze point is determined based on the user's facial offset direction and / or the user's iris offset direction.

[0052] In one embodiment, the adjustment module is further configured to:

[0053] When the movement trend of the line of sight does not approach the target point, it is determined that the rearview mirror angle does not need to be adjusted.

[0054] This application also provides a rearview mirror adjustment system, including:

[0055] At least one processor; and,

[0056] A memory communicatively connected to the at least one processor; wherein,

[0057] The memory stores instructions that can be executed by the at least one processor to implement the rearview mirror adjustment method described in any of the above embodiments.

[0058] This application also provides a computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor corresponding to the rearview mirror adjustment system, enables the rearview mirror adjustment system to implement the rearview mirror adjustment method described in any of the above embodiments.

[0059] Other features and advantages of this application will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0060] The technical solution of this application will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0061] The accompanying drawings are provided to further illustrate the present application and form part of the specification. They are used together with the embodiments of the present application to explain the application and do not constitute a limitation thereof. In the drawings:

[0062] Figure 1 This is a flowchart of a rearview mirror adjustment method according to an embodiment of this application;

[0063] Figure 2 This is a structural diagram of a rearview mirror adjustment device according to an embodiment of this application;

[0064] Figure 3 This is a schematic diagram of the hardware structure of a rearview mirror adjustment system according to an embodiment of this application. Detailed Implementation

[0065] The preferred embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit this application.

[0066] Figure 1 This is a flowchart of a rearview mirror adjustment method according to one embodiment of this application. This method can be used to automatically adjust the angle of the vehicle's rearview mirrors based on the user's line of sight and its movement trend during vehicle operation, improving driving convenience and safety. Figure 1 As shown, the method can be implemented as follows: S101-S104:

[0067] In step S101, the user's line of sight is acquired during the vehicle's movement;

[0068] In step S102, when the user's line of sight is located on the vehicle's rearview mirror, the target point on the edge line of the rearview mirror that is closest to the user's line of sight is determined.

[0069] In step S103, when the distance between the target point and the line of sight is less than a first preset distance, the movement trend of the line of sight is obtained;

[0070] In step S104, when the movement trend of the line of sight is towards the target point, the angle of the rearview mirror is adjusted to increase the user's field of vision within a preset area centered on the line of sight location.

[0071] During vehicle movement, the user's gaze point is acquired. This application allows for various methods to acquire the user's gaze. For example, an eye tracker can be used to acquire the user's gaze point. Specifically, the eye tracker acquires the user's eye movement data, including eye position coordinates, pupil diameter, fixation point coordinates, and fixation time. Then, the user's gaze point is determined based on the eye movement data. Due to random errors during data acquisition and the presence of nystagmus, microsaccades, and microsalivations during eye movements, the raw eye movement data is preprocessed based on pupil diameter, fixation time, etc., and the fixation points are merged based on fixation time and fixation point movement distance to obtain the user's gaze point.

[0072] For example, calibration can be performed by combining the user's facial and iris offset data collected by the camera with the eye-tracking device to obtain the user's gaze point. The camera acquires the user's facial and iris offset data by analyzing the positional changes of feature points on the user's face and eyes. First, the user's first gaze point is determined based on the eye-tracking data. As mentioned above, the first gaze point is obtained by preprocessing and merging the eye-tracking data. Second, the user's second gaze point is determined based on the facial and iris offset data. When obtaining the second gaze point, a 3D spatial model can be constructed based on the camera's position, the relative position of the camera and the rearview mirror, the user's relative position to the rearview mirror, and the user's iris and facial offset data. The coordinates of the user's two eyes, the gaze direction, and the coordinates of the rearview mirror are then determined, thus identifying the gaze point on the rearview mirror as the second gaze point. Furthermore, the second gaze point can also be obtained by combining the gaze point acquired by the eye-tracking device with the offset direction and amount of the user's face and iris. Specifically, the user's gaze point before facial and iris shifts is obtained from the eye tracker. The determination of this gaze point is as described above and will not be repeated here. Then, based on the gaze point before facial and iris shifts, and the facial and / or iris shift amounts, the user's second gaze point is determined. Since the spatial coordinates of the gaze point are available, combined with the facial and / or iris shift amounts, the shifted gaze point is determined as the second gaze point. Next, it is determined whether the distance between the first and second gaze points is less than a second preset distance. To avoid data acquisition errors, the first gaze point obtained from the eye-tracking data is compared with the second gaze point obtained from the data acquired by the camera. If the data acquisition is correct, the distance between the first and second gaze points should be less than the second preset distance. Therefore, when the distance between the first and second gaze points is less than the second preset distance, the first gaze point is determined to be the user's gaze point. When the distance between the first line of sight and the second line of sight is greater than the second preset distance, it indicates that there is a deviation in the data collection. The center point of the line segment with the first line of sight and the second line of sight as endpoints is taken as the user's line of sight.

[0073] When the user's line of sight is on the vehicle's rearview mirror, the target point on the edge line of the rearview mirror that is closest to the user's line of sight is determined. In order to determine whether the user intends to adjust the rearview mirror, in this embodiment, when the user's line of sight is on the vehicle's rearview mirror, the target point on the edge line of the rearview mirror that is closest to the user's line of sight is determined based on the relationship between the line of sight and the edge line of the rearview mirror.

[0074] When the distance between the target point and the point of gaze is less than a first preset distance, the movement trend of the point of gaze is obtained. When the distance between the target point and the point of gaze is less than the first preset distance, it indicates that the user's gaze is close to the edge of the rearview mirror. In this case, to determine whether the current field of view meets the user's needs, the movement trend of the user's gaze is determined using facial offset data and iris offset data collected by the camera. The user's facial offset data includes the user's facial offset direction, and the user's iris offset data includes the user's iris offset direction. The movement trend of the gaze is determined based on the user's facial offset direction and / or iris offset direction. Specifically, the facial offset direction can be directly used as the movement trend of the gaze; the iris offset direction can also be directly used as the movement trend of the gaze; alternatively, a facial offset vector can be obtained from the facial offset direction and offset amount, and an iris offset vector can be obtained from the iris offset direction and offset amount. The vector obtained by adding the facial offset vector and the iris offset vector is then used as the movement trend of the gaze.

[0075] When the movement trend of the gaze point is towards the target point, the rearview mirror angle is adjusted to increase the user's field of vision within a preset area centered on the gaze point. To determine whether the rearview mirror's field of vision meets the user's needs, if the distance between the target point at the edge of the rearview mirror and the user's gaze point is less than a first preset distance, and the movement trend of the user's gaze is still towards the target point at the edge of the rearview mirror, then the user's field of vision is in the direction of the target point. Therefore, the rearview mirror angle is adjusted along the movement trend of the gaze point to increase the user's field of vision within the preset area centered on the gaze point. Specifically, adjustments can be made according to a preset step size. During the adjustment process, the user's gaze point is continuously monitored until the movement trend of the user's gaze point no longer tends towards the target point. When the movement trend of the gaze point is no longer towards the target point, it is determined that the rearview mirror angle does not need to be adjusted.

[0076] The beneficial effects of this application are as follows: During vehicle movement, the user's line of sight is acquired; when the user's line of sight is on the rearview mirror, the target point closest to the user's line of sight is determined on the edge of the rearview mirror; when the distance between the user's line of sight and the target point is less than a first preset distance, the movement trend of the line of sight is acquired; when the movement trend of the line of sight is towards the target point, the angle of the rearview mirror is adjusted to increase the user's field of vision within a preset area centered on the line of sight position. Therefore, the angle of the vehicle's rearview mirror can be automatically adjusted according to the user's line of sight and its movement trend during vehicle movement, improving driving convenience and safety.

[0077] In one embodiment, step S101 above can be implemented as steps A1-A2 as follows:

[0078] In step A1, the user's eye movement data is acquired using an eye tracker;

[0079] In step A2, the user's gaze point is determined based on the user's eye movement data.

[0080] In this embodiment, eye movement data of the user is obtained from an eye tracker, including eye position coordinates, pupil diameter, fixation point coordinates, and fixation time.

[0081] Then, the user's gaze point is determined based on the user's eye movement data. Due to random errors during data acquisition, the raw eye movement data is preprocessed according to pupil diameter, fixation time, etc., and fixation points with fixation time greater than a preset time or fixation point movement distance less than a preset distance are merged to obtain the user's gaze point.

[0082] In one embodiment, step S101 above can be implemented as steps B1-B2 as follows:

[0083] In step B1, the user's eye movement data is obtained from the eye tracker, and the user's facial offset data and iris offset data are obtained from the camera.

[0084] In step B2, the user's gaze point is determined based on the eye movement data, the user's facial offset data, and the user's iris offset data.

[0085] In this embodiment, eye-tracking data of the user is acquired using an eye tracker, and facial and iris offset data of the user are acquired using a camera. The eye-tracking data includes eye position coordinates, pupil diameter, fixation point coordinates, and fixation time, etc. The eye-tracking data acquired by the eye tracker can determine the user's gaze point. The facial and iris offset data acquired by the camera are determined by the positional changes of feature points on the user's face and eyes, and are calibrated in conjunction with the facial and iris offset data acquired by the camera.

[0086] The user's gaze point is determined based on the eye-tracking data, the user's facial offset data, and the user's iris offset data. Specifically, a first gaze point is determined based on the eye-tracking data, and a second gaze point is determined based on the user's facial offset data and iris offset data. As mentioned above, the first gaze point is obtained by preprocessing and merging the eye-tracking data collected by the eye tracker. The second gaze point can be obtained by combining the gaze point obtained by the eye tracker with the offset direction and amount of the user's face and iris. Specifically, the gaze point before the facial and iris offset is obtained by the eye tracker; the determination of this gaze point is the same as the first gaze point described above, and will not be repeated here. Then, the second gaze point is determined based on the gaze point before the facial and iris offset, as well as the facial offset and / or iris offset. Since the spatial coordinates of the gaze point can be obtained, combined with the facial offset and / or iris offset, the offset gaze point is determined as the second gaze point. Determine whether the distance between the first line of sight and the second line of sight is less than a second preset distance; when the distance between the first line of sight and the second line of sight is less than the second preset distance, determine the first line of sight as the user's line of sight; when the distance between the first line of sight and the second line of sight is greater than the second preset distance, take the center point of the line segment with the first line of sight and the second line of sight as endpoints as the user's line of sight.

[0087] In one embodiment, step B2 above can be implemented as steps B21-B23 as follows:

[0088] In step B21, the user's first gaze point is determined based on the eye movement data, and the user's second gaze point is determined based on the user's facial offset data and iris offset data.

[0089] In step B22, it is determined whether the distance between the first line of sight and the second line of sight is less than a second preset distance;

[0090] In step B23, when the distance between the first line of sight and the second line of sight is less than a second preset distance, the first line of sight is determined to be the user's line of sight.

[0091] In this embodiment, the user's first gaze point is determined based on the eye-tracking data, and the user's second gaze point is determined based on the user's facial offset data and iris offset data. As mentioned above, the first gaze point is obtained by preprocessing and merging the eye-tracking data collected by the eye tracker. When obtaining the second gaze point, a 3D spatial model can be constructed based on the camera's position, the relative position of the camera and the rearview mirror, the relative position of the user and the rearview mirror, as well as the user's iris offset data and facial offset data. The coordinates of the user's two eyes, the gaze direction, and the coordinates of the rearview mirror are then determined, thus identifying the gaze point in the rearview mirror as the second gaze point. Alternatively, the second gaze point can be obtained by combining the gaze point obtained from the eye tracker with the offset direction and amount of the user's face and iris. Specifically, the eye tracker obtains the gaze point before the face and iris shifts. The determination of this gaze point is the same as described above and will not be repeated here. Then, based on the gaze point before the face and iris shifts, and the face shift amount and / or iris shift amount, the user's second gaze point is determined. Since the spatial coordinates of the gaze point can be obtained, combined with the face shift amount and / or iris shift amount, the gaze point after the shift is determined, which is the second gaze point.

[0092] The system determines whether the distance between the first and second gaze points is less than a second preset distance. To avoid data acquisition errors, the first gaze point obtained from eye-tracking data collected by the eye tracker is compared with the second gaze point obtained from data collected by the camera. If the data acquisition is correct, the distance between the first and second gaze points should be less than the second preset distance. Therefore, when the distance between the first and second gaze points is less than the second preset distance, the first gaze point is determined to be the user's gaze point. When the distance between the first and second gaze points is greater than the second preset distance, it indicates a data acquisition deviation, and the center point of the line segment with the first and second gaze points as endpoints can be taken as the user's gaze point.

[0093] In one embodiment, the user's facial offset data includes a facial offset amount, and the user's iris offset data includes an iris offset amount. Step B21 above can be implemented as follows: steps B211-B212:

[0094] In step B211, the gaze point before the face and iris shifts is obtained using an eye tracker;

[0095] In step B212, the user's second gaze point is determined based on the gaze point before the face and iris shift, and the face shift amount and / or iris shift amount.

[0096] In this embodiment, the gaze point before facial and iris deviation is obtained using an eye tracker. The determination of this gaze point, like the determination of the first gaze point described above, is obtained through eye-tracking data acquired by the eye tracker, and will not be repeated here.

[0097] The user's second gaze point is determined based on the gaze point before the face and iris shift, and the face and / or iris shift amounts. Since the spatial coordinates of the gaze point before the face and iris shift can be obtained, the spatial coordinates of the gaze point after the shift, i.e., the second gaze point, can be determined by combining the face and / or iris shift amounts.

[0098] In one embodiment, the method may be implemented as step B24:

[0099] In step B24, when the distance between the first line of sight and the second line of sight is greater than the second preset distance, the center point of the line segment with the first line of sight and the second line of sight as endpoints is taken as the user's line of sight.

[0100] In this embodiment, to avoid data acquisition errors, the first gaze point obtained from the eye-tracking data collected by the eye tracker is compared with the second gaze point obtained from the data collected by the camera. When the distance between the first gaze point and the second gaze point is greater than a second preset distance, it indicates that there is a deviation in data acquisition. The center point of the line segment with the first gaze point and the second gaze point as endpoints can be taken as the user's gaze point.

[0101] The beneficial effect of this embodiment is that by using the user's facial and iris data collected by the camera to calibrate the user's failed landing point, the probability of deviation in the collection of user's line of sight landing point data is reduced.

[0102] In one embodiment, the user's facial offset data includes the user's facial offset direction, and the user's iris offset data includes the user's iris offset direction. Step S103 can be implemented as follows:

[0103] The movement trend of the gaze point is determined based on the user's facial offset direction and / or the user's iris offset direction.

[0104] In this embodiment, to determine whether the current field of view meets the user's needs, the movement trend of the user's gaze point is determined using facial offset data and iris offset data collected by the camera. The user's facial offset data includes the direction of facial offset, and the user's iris offset data includes the direction of iris offset. The movement trend of the gaze point is determined based on the user's facial offset direction and / or iris offset direction. Specifically, the facial offset direction can be directly used as the movement trend of the gaze point; alternatively, the iris offset direction can be directly used as the movement trend of the gaze point; alternatively, a facial offset vector can be obtained from the facial offset direction and offset amount, and an iris offset vector can be obtained from the iris offset direction and offset amount, and then the facial offset vector and iris offset vector are added together to obtain the movement trend of the gaze point.

[0105] The beneficial effects of this embodiment are as follows: by collecting facial and iris offset data of the user through the camera, the movement trend of the user's gaze point is determined, and then the user's adjustment intention is determined. The angle of the rearview mirror is adjusted according to the user's adjustment intention, thereby realizing automatic adjustment of the rearview mirror and improving driving convenience and safety.

[0106] In one embodiment, the method may also be implemented as follows:

[0107] When the movement trend of the line of sight does not approach the target point, it is determined that the rearview mirror angle does not need to be adjusted.

[0108] In this embodiment, when the movement trend of the line of sight does not approach the target point, it indicates that the field of vision in the direction of the target point is not the user's target direction, and therefore it is determined that the rearview mirror angle does not need to be adjusted.

[0109] The beneficial effect of this embodiment is that during the rearview mirror adjustment process, the adjustment angle of the rearview mirror is determined by monitoring the movement trend of the user's line of sight, and the adjustment stops when the movement trend no longer approaches the target point, thereby realizing the automatic adjustment of the rearview mirror without the need for manual adjustment by the user, which improves the convenience and safety of driving.

[0110] Figure 2 This is a structural diagram of a rearview mirror adjustment device according to an embodiment of this application, as shown below. Figure 2 As shown, it includes:

[0111] The first acquisition module 201 is used to acquire the user's line of sight during the vehicle's movement;

[0112] The determination module 202 is used to determine the target point on the edge line of the rearview mirror that is closest to the user's line of sight when the user's line of sight is located on the vehicle's rearview mirror.

[0113] The second acquisition module 203 is used to acquire the movement trend of the line of sight when the distance between the target point and the line of sight landing point is less than a first preset distance;

[0114] The adjustment module 204 is used to adjust the angle of the rearview mirror when the movement trend of the line of sight is approaching the target point, so as to increase the user's field of vision range within a preset area centered on the line of sight position.

[0115] In one embodiment, the first acquisition module includes:

[0116] The first acquisition submodule is used to acquire the user's eye movement data based on the eye tracker;

[0117] The first determining submodule is used to determine the user's gaze point based on the user's eye movement data.

[0118] In one embodiment, the first acquisition module includes:

[0119] The second acquisition submodule is used to acquire the user's eye movement data based on the eye tracker, and to acquire the user's facial offset data and iris offset data based on the camera.

[0120] The second determining submodule is used to determine the user's gaze point based on the eye movement data, the user's facial offset data, and the user's iris offset data.

[0121] In one embodiment, the second determining submodule is further configured to:

[0122] The user's first gaze point is determined based on the eye movement data, and the user's second gaze point is determined based on the user's facial offset data and iris offset data.

[0123] Determine whether the distance between the first line of sight and the second line of sight is less than a second preset distance;

[0124] When the distance between the first line of sight and the second line of sight is less than the second preset distance, the first line of sight is determined to be the user's line of sight.

[0125] In one embodiment, the user's facial offset data includes a facial offset amount, and the user's iris offset data includes an iris offset amount. Determining the user's second gaze point based on the user's facial offset data and iris offset data includes:

[0126] The eye tracker obtains the point of gaze before the face and iris shift;

[0127] The user's second gaze point is determined based on the gaze point before the facial and iris offset, and the facial offset and / or iris offset.

[0128] In one embodiment, the second determining submodule is further configured to:

[0129] When the distance between the first line of sight and the second line of sight is greater than the second preset distance, the center point of the line segment with the first line of sight and the second line of sight as endpoints is the user's line of sight.

[0130] In one embodiment, the user's facial offset data includes the user's facial offset direction, the user's iris offset data includes the user's iris offset direction, and obtaining the movement trend of the gaze point includes:

[0131] The movement trend of the gaze point is determined based on the user's facial offset direction and / or the user's iris offset direction.

[0132] In one embodiment, the adjustment module is further configured to:

[0133] When the movement trend of the line of sight does not approach the target point, it is determined that the rearview mirror angle does not need to be adjusted.

[0134] Figure 3 This is a schematic diagram of the hardware structure of a rearview mirror adjustment system according to an embodiment of this application, as shown below. Figure 3 As shown, the rearview mirror adjustment system includes:

[0135] At least one processor 320; and,

[0136] Memory 304 communicatively connected to the at least one processor 320; wherein,

[0137] The memory 304 stores instructions that can be executed by the at least one processor 320 to implement the rearview mirror adjustment method described in any of the above embodiments.

[0138] Reference Figure 3 The rearview mirror adjustment system 300 may include one or more of the following components: a processing component 302, a memory 304, a power supply component 306, a multimedia component 308, an audio component 310, an input / output (I / O) interface 312, a sensor component 314, and a communication component 316.

[0139] Processing component 302 typically controls the overall operation of the rearview mirror adjustment system 300. Processing component 302 may include one or more processors 320 to execute instructions to complete all or part of the steps of the method described above. Furthermore, processing component 302 may include one or more modules to facilitate interaction between processing component 302 and other components. For example, processing component 302 may include a multimedia module to facilitate interaction between multimedia component 308 and processing component 302.

[0140] Memory 304 is configured to store various types of data to support the operation of the rearview mirror adjustment system 300. Examples of this data include instructions for any application or method operating on the rearview mirror adjustment system 300, such as text, images, videos, etc. Memory 304 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0141] The power supply assembly 306 provides power to the various components of the rearview mirror adjustment system 300. The power supply assembly 306 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the vehicle control system 300.

[0142] The multimedia component 308 includes a screen that provides an output interface between the rearview mirror adjustment system 300 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 308 may also include a front-facing camera and / or a rear-facing camera. When the rearview mirror adjustment system 300 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0143] Audio component 310 is configured to output and / or input audio signals. For example, audio component 310 includes a microphone (MIC) configured to receive external audio signals when the rearview mirror adjustment system 300 is in an operating mode, such as alarm mode, recording mode, voice recognition mode, and voice output mode. The received audio signals may be further stored in memory 304 or transmitted via communication component 316. In some embodiments, audio component 310 also includes a speaker for outputting audio signals.

[0144] I / O interface 312 provides an interface between processing component 302 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0145] Sensor assembly 314 includes one or more sensors for providing status assessments of various aspects of the rearview mirror adjustment system 300. For example, sensor assembly 314 may include a sound sensor. Additionally, sensor assembly 314 may detect the on / off state of the rearview mirror adjustment system 300, the relative positioning of components (e.g., the display and keypad of the rearview mirror adjustment system 300), and the operating state of the rearview mirror adjustment system 300 or one of its components, such as the operating state of the air distribution panel, structural state, the operating state of the discharge scraper, the orientation or acceleration / deceleration of the rearview mirror adjustment system 300, and temperature changes of the rearview mirror adjustment system 300. Sensor assembly 314 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 314 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, a material buildup thickness sensor, or a temperature sensor.

[0146] Communication component 316 is configured to enable rearview mirror adjustment system 300 to provide wired or wireless communication capabilities with other devices and cloud platforms. Rearview mirror adjustment system 300 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 316 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 316 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0147] In an exemplary embodiment, the rearview mirror adjustment system 300 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the rearview mirror adjustment method described in any of the above embodiments.

[0148] This application also provides a computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor corresponding to the rearview mirror adjustment system, enables the rearview mirror adjustment system to implement the rearview mirror adjustment method described in any of the above embodiments.

[0149] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0150] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0151] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0152] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0153] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A method for adjusting a rearview mirror, characterized in that, include: During vehicle movement, the user's line of sight is determined; When the user's line of sight is on the vehicle's rearview mirror, determine the target point on the edge line of the rearview mirror that is closest to the user's line of sight. When the distance between the target point and the point of view is less than a first preset distance, the movement trend of the point of view is obtained; When the movement trend of the line of sight is closer to the target point, the angle of the rearview mirror is adjusted to increase the user's field of vision within a preset area centered on the line of sight position. The process of obtaining the user's gaze point includes: The system acquires the user's eye movement data using an eye tracker, and also acquires the user's facial offset data and iris offset data using a camera. The user's gaze point is determined based on the eye movement data, the user's facial offset data, and the user's iris offset data. Determining the user's gaze point based on the eye movement data, the user's facial offset data, and the user's iris offset data includes: The user's first gaze point is determined based on the eye movement data, and the user's second gaze point is determined based on the user's facial offset data and iris offset data. Determine whether the distance between the first line of sight and the second line of sight is less than a second preset distance; When the distance between the first line of sight and the second line of sight is less than the second preset distance, the first line of sight is determined to be the user's line of sight. The user's facial offset data includes the user's facial offset direction, the user's iris offset data includes the user's iris offset direction, and obtaining the movement trend of the gaze point includes: The movement trend of the gaze point is determined based on the user's facial offset direction and / or the user's iris offset direction.

2. The method as described in claim 1, characterized in that, The method further includes: When the distance between the first line of sight and the second line of sight is greater than the second preset distance, the center point of the line segment with the first line of sight and the second line of sight as endpoints is the user's line of sight.

3. The method as described in claim 1, characterized in that, The method further includes: When the movement trend of the line of sight does not approach the target point, it is determined that the rearview mirror angle does not need to be adjusted.

4. A rearview mirror adjustment device, used in the rearview mirror adjustment method as described in any one of claims 1-3, characterized in that, include: The first acquisition module is used to acquire the user's line of sight during vehicle movement; The determination module is used to determine the target point on the edge line of the rearview mirror that is closest to the user's line of sight when the user's line of sight is located on the vehicle's rearview mirror. The second acquisition module is used to acquire the movement trend of the line of sight when the distance between the target point and the line of sight landing point is less than a first preset distance; The adjustment module is used to adjust the angle of the rearview mirror when the movement trend of the line of sight is approaching the target point, so as to increase the user's field of vision within a preset area centered on the position of the line of sight.

5. A rearview mirror adjustment system, characterized in that, include: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to implement the rearview mirror adjustment method as described in any one of claims 1-3.

6. A computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor corresponding to the rearview mirror adjustment system, the rearview mirror adjustment system is able to implement the rearview mirror adjustment method as described in any one of claims 1-3.

Images