Electronic rearview mirror adjusting method and device, equipment and storage medium
By determining the offset distance and direction of the driver's head position in the electronic rearview mirror and dynamically adjusting the camera angle, the problem that the electronic rearview mirror cannot adjust the field of view and viewing angle is solved, and the driver's driving safety and observation convenience are improved sex.
Patent Information
- Application Number
- CN202411185628.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-27
- Publication Date
- 2024-11-08
AI Technical Summary
The electronic rearview mirror cannot adjust the field of view or perspective by adjusting the observation position, which leads to the inability to automatically adjust the angle of the vehicle rearview mirror when it is necessary to adjust the rearview mirror, affecting the driver's observation of the road and driving safety.
By determining the offset distance and direction between the driver's head and the reference position of the vehicle, adjusting the camera angle of the electronic rearview mirror to automatically adjust the field of view or viewing angle according to the change of the driver's head position, realizing the dynamics of the electronic rearview mirror adjust.
When the driver's head position changes, the camera angle of the electronic rearview mirror can be automatically adjusted, which improves the driver's convenience of observing the road and driving safety, simplifies the calculation process of angle adjustment, and ensures that the maximum is quickly achieved when parallel or turning. Visual angle.
Smart Images

Figure CN118906974A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of vehicle technology, in particular to the field of electronic rearview mirror technology, and specifically to an adjustment method, device, equipment and storage medium for an electronic rearview mirror. Background Art
[0002] With the continuous development of automobile technology, it is becoming a trend to replace traditional outer rearview mirrors with electronic rearview mirrors. Electronic rearview mirrors use cameras placed in the original outer rearview mirror position to obtain the rear view of the vehicle and transmit it to the screen set up in the car. Since the rotation of the camera is more flexible and has a larger rotation angle than the traditional rearview mirror, it greatly reduces the blind spot of the field of vision. It can also reduce the width of the vehicle and reduce the wind resistance of the vehicle when driving, thereby improving the performance of the vehicle to a certain extent.
[0003] However, electronic rearview mirrors also have some defects, such as: the image is fixed, and when people who are used to using optical rearview mirrors need to adjust the field of view when using the electronic rearview mirror, they cannot adjust the field of view or viewing angle. For example, publication number CN117400832 A discloses: an electronic rearview mirror field of view switching method, applied to an electronic rearview mirror system including an electronic rearview mirror and an image acquisition device, including a control end receiving a display switching instruction, and sending a control instruction to the electronic rearview mirror according to the display switching instruction. The electronic rearview mirror performs field of view switching according to the control instruction, switching the electronic rearview mirror mode to the image acquisition mode; in the electronic rearview mirror mode, the electronic rearview mirror displays the field of view of the first area; in the image acquisition mode, the electronic rearview mirror displays the field of view of the second area, and the field of view of the second area is acquired by the image acquisition device. Even if the display content is adjustable, it is not dynamically adjusted, but a fixed display content is set according to demand. Summary of the invention
[0004] The present application provides an adjustment method, device, equipment and storage medium for an electronic rearview mirror, so as to at least solve the technical problem in the related art that the electronic rearview mirror cannot adjust the field of view or viewing angle by adjusting the observation position. The technical solution of the present application is as follows:
[0005] According to a first aspect of the present application, a method for adjusting an electronic rearview mirror is provided, comprising: determining an offset distance and an offset direction between a current position of a driver's head of a vehicle and a reference position. When the electronic rearview mirror is in an angle adjustment mode and the offset direction is a target direction, determining an adjustment angle of a camera of the electronic rearview mirror of the vehicle according to the offset distance, and adjusting the camera of the electronic rearview mirror according to the adjustment angle.
[0006] According to the above technical means, when the position of the driver's head changes, the offset distance of the current position of the driver's head compared to the preset position is calculated. Alternatively, when the electronic rearview mirror is in the angle adjustment mode, the adjustment angle of the camera of the electronic rearview mirror is determined according to the offset distance, and the camera of the electronic rearview mirror is adjusted according to the adjustment angle. In this way, the angle of the camera of the electronic rearview mirror is adjusted according to the change of the driver's head position, and the field of view or viewing angle can be adjusted by adjusting the observation position, so that the angle of the vehicle rearview mirror is automatically adjusted when the rearview mirror needs to be adjusted, so as to facilitate the driver to observe the road conditions and ensure driving safety.
[0007] In one possible method, the adjustment angle of the camera of the electronic rearview mirror is determined according to the offset distance, including: determining the adjustment angle of the camera of the electronic rearview mirror according to the offset distance, the maximum offset angle corresponding to the camera in the offset direction, and a preset offset extreme value corresponding to the driver's head; adjusting the camera of the electronic rearview mirror according to the adjustment angle, including: adjusting the camera of the electronic rearview mirror according to the adjustment angle and the offset direction.
[0008] According to the above technical means, the adjustment angle of the camera can be determined according to the offset distance, the maximum adjustment angle and the preset offset extreme value. In this way, the calculation method is simple and the calculation complexity of the adjustment angle can be reduced.
[0009] In one possible approach, the target direction is a horizontal direction or a vertical direction; the horizontal direction is a direction in which the driver's head moves left and right, and the vertical direction is a direction in which the driver's head moves up and down.
[0010] According to the above technical means, after the driver's head is offset in the horizontal direction or the vertical direction, the angle of the camera is adjusted according to the offset direction. In this way, the calculation method is simple and the calculation complexity of adjusting the angle can be reduced.
[0011] In one possible manner, the adjustment angle of the camera of the electronic rearview mirror is determined according to the offset distance, the maximum adjustment angle corresponding to the offset direction, and the preset offset extreme value, including: determining the initial adjustment angle according to the offset distance, the maximum adjustment angle, and the preset offset extreme value. The initial adjustment angle is the product of the offset distance and the unit adjustment angle, and the unit adjustment angle is the ratio of the maximum adjustment angle to the preset offset extreme value. The initial adjustment angle is corrected according to the correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror.
[0012] In one possible method, when the vehicle is in a merging or turning state, the initial adjustment angle is corrected according to the correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror, including: the sum of the intermediate adjustment angle and the preset adjustment angle is determined as the adjustment angle of the camera of the electronic rearview mirror; the intermediate adjustment angle is the product of the correction coefficient and the initial adjustment angle.
[0013] According to the above technical means, when the vehicle needs to reach the maximum viewing angle as quickly as possible when changing lanes or turning, the preset adjustment angle can be stepped to the angle to be adjusted, so that the rearview mirror will display the maximum viewing angle at the fastest speed, thereby improving driving safety.
[0014] In one possible embodiment, the method further includes: when the electronic rearview mirror is in a display content adjustment mode, determining the number of adjusted pixels based on the offset distance and the number of unit pixels; the number of unit pixels is used to characterize the number of pixels corresponding to the unit offset distance; and adjusting the display content of the display screen according to the number of adjusted pixels.
[0015] In one possible embodiment, the method further includes: obtaining image information of the seat where the driver is currently located; determining the initial position of the driver's head and the initial position of the seat based on the image information, calculating the deviation value between the initial position of the seat and the actual position of the seat, and correcting the initial position based on the deviation value to obtain the current position of the driver's head.
[0016] In one possible embodiment, the method further includes: when the offset direction is a focusing direction, determining a focal length adjustment value of a camera of the electronic rearview mirror of the vehicle according to the offset distance and a target correspondence relationship, and adjusting the focal length of the camera of the electronic rearview mirror according to the focal length adjustment value; the adjustment direction is a direction in which the driver's head moves forward and backward, and the target correspondence relationship includes multiple offset distances and a focal length adjustment value corresponding to each of the multiple offset distances.
[0017] According to a second aspect provided by the present application, an adjustment device for an electronic rearview mirror is provided, comprising: a determination unit and a processing unit. The determination unit is used to determine an offset distance and an offset direction between a current position of a driver's head of a vehicle and a reference position. The determination unit is also used to determine an adjustment angle of a camera of the electronic rearview mirror of the vehicle according to the offset distance when the electronic rearview mirror is in an angle adjustment mode and the offset direction is a target direction. The processing unit is used to adjust the camera of the electronic rearview mirror according to the adjustment angle.
[0018] In one possible manner, the determination unit is specifically used to: determine the adjustment angle of the camera of the electronic rearview mirror based on the offset distance, the maximum offset angle corresponding to the camera in the offset direction, and the preset offset extreme value corresponding to the driver's head; adjust the camera of the electronic rearview mirror according to the adjustment angle, including: adjusting the camera of the electronic rearview mirror according to the adjustment angle and the offset direction.
[0019] In one possible approach, the target direction is a horizontal direction or a vertical direction; the horizontal direction is a direction in which the driver's head moves left and right, and the vertical direction is a direction in which the driver's head moves up and down.
[0020] In one possible manner, the determination unit is specifically configured to: determine an initial adjustment angle according to the offset distance, the maximum adjustment angle, and the preset offset extreme value. The initial adjustment angle is the product of the offset distance and the unit adjustment angle, and the unit adjustment angle is the ratio of the maximum adjustment angle to the preset offset extreme value. The initial adjustment angle is corrected according to the correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror.
[0021] In one possible manner, when the vehicle is in a merging or turning state, a determination unit is specifically used to: determine the sum of the intermediate adjustment angle and the preset adjustment angle as the adjustment angle of the camera of the electronic rearview mirror; the intermediate adjustment angle is the product of the correction coefficient and the initial adjustment angle.
[0022] In one possible manner, the determination unit is further configured to determine the number of adjustment pixels according to the offset distance and the number of unit pixels when the electronic rearview mirror is in a display content adjustment mode; the number of unit pixels is used to represent the number of pixels corresponding to the unit offset distance. The processing unit is further configured to adjust the display content of the display screen according to the number of adjustment pixels.
[0023] In one possible manner, the adjustment device further includes: an acquisition unit. The acquisition unit is used to acquire image information of the seat where the driver is currently located. The processing unit is also used to determine the initial position of the driver's head and the initial position of the seat according to the image information, calculate the deviation value between the initial position of the seat and the actual position of the seat, and correct the initial position according to the deviation value to obtain the current position of the driver's head.
[0024] In one possible manner, the determination unit is further used to determine the focal length adjustment value of the camera of the electronic rearview mirror of the vehicle according to the offset distance and the target correspondence when the offset direction is the focus direction. The processing unit is further used to adjust the focal length of the camera of the electronic rearview mirror according to the focal length adjustment value; the adjustment direction is the direction in which the driver's head moves forward and backward, and the target correspondence includes multiple offset distances and the focal length adjustment value corresponding to each of the multiple offset distances.
[0025] According to the third aspect provided by the present application, an electronic device is provided, comprising: a processor; a memory for storing processor executable instructions; wherein the processor is configured to execute instructions to implement the method of the above-mentioned first aspect and any possible implementation manner thereof.
[0026] According to the fourth aspect provided by the present application, a computer-readable storage medium is provided. When the instructions in the computer-readable storage medium are executed by a processor of a processing device, the processing device is enabled to execute the method in the above-mentioned first aspect and any possible implementation method thereof.
[0027] According to the fifth aspect provided by the present application, a computer program product is provided, the computer program product comprising computer instructions, and when the computer instructions are executed on a processing device, the processing device executes the method of the above-mentioned first aspect and any possible implementation manner thereof.
[0028] According to a sixth aspect provided by the present application, a vehicle is provided, comprising the electronic device of the third aspect.
[0029] Therefore, the above technical features of the present application have the following beneficial effects:
[0030] (1) When the position of the driver's head changes, the offset distance of the current position of the driver's head compared to the preset position is calculated. Alternatively, when the electronic rearview mirror is in the angle adjustment mode, the adjustment angle of the camera of the electronic rearview mirror is determined according to the offset distance, and the camera of the electronic rearview mirror is adjusted according to the adjustment angle. In this way, the angle of the camera of the electronic rearview mirror is adjusted according to the change of the driver's head position, and the field of view or viewing angle can be adjusted by adjusting the observation position, so that the angle of the vehicle rearview mirror is automatically adjusted when the rearview mirror needs to be adjusted, so as to facilitate the driver to observe the road conditions and ensure driving safety.
[0031] (2) The adjustment angle of the camera can be determined according to the offset distance, the maximum adjustment angle, and the preset offset extreme value. In this way, the corresponding adjustment angle of the camera in the offset direction can be determined by simply calculating the offset distance of the driver's head in the offset direction. The calculation method is simple and can reduce the calculation complexity of the adjustment angle.
[0032] (3) After the driver's head is offset in the horizontal direction or the vertical direction, the angle of the camera is adjusted according to the offset direction. In this way, the calculation method is simple and the calculation complexity of the adjustment angle can be reduced.
[0033] (4) When the vehicle needs to reach the maximum viewing angle as quickly as possible when changing lanes or turning, the preset adjustment angle can be stepped to the angle to be adjusted. In this way, the rearview mirror will display the maximum viewing angle at the fastest speed, thereby improving driving safety.
[0034] It should be noted that the technical effects brought about by any implementation method in the second to sixth aspects can refer to the technical effects brought about by the corresponding implementation method in the first aspect, and will not be repeated here.
[0035] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] The drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present application, and together with the specification are used to explain the principles of the present application, and do not constitute an improper limitation on the present application.
[0037] Figure 1 is a schematic structural diagram of an adjustment system for an electronic rearview mirror according to an exemplary embodiment;
[0038] Figure 2 is a schematic structural diagram of a vehicle according to an exemplary embodiment;
[0039] Figure 3 is a schematic diagram of camera shaking according to an exemplary embodiment;
[0040] Figure 4 is one of the flowcharts of a method for adjusting an electronic rearview mirror according to an exemplary embodiment;
[0041] Figure 5 is a schematic diagram showing a driver's deviation in the X direction according to an exemplary embodiment;
[0042] Figure 6 is a schematic diagram showing a driver's deviation in the H direction according to an exemplary embodiment;
[0043] Figure 7 is a schematic diagram showing a driver's deviation in the Y direction according to an exemplary embodiment;
[0044] Figure 8 is a schematic diagram showing a preset position of a driver's head according to an exemplary embodiment;
[0045] Fig. 9 is one of the schematic diagrams showing determination of an adjustment angle according to an exemplary embodiment;
[0046] Fig.10 is a second schematic diagram showing determination of an adjustment angle according to an exemplary embodiment;
[0047] Fig.11 is a third schematic diagram showing determination of an adjustment angle according to an exemplary embodiment;
[0048] Fig.12 is a schematic diagram showing a method for adjusting an electronic rearview mirror according to an exemplary embodiment;
[0049] Fig.13 is a schematic diagram showing a driver's head being offset in the Y direction according to an exemplary embodiment;
[0050] Fig.14 is a second flow chart of a method for adjusting an electronic rearview mirror according to an exemplary embodiment;
[0051] Fig.15 is a third flow chart of a method for adjusting an electronic rearview mirror according to an exemplary embodiment;
[0052] Fig.16 is a block diagram of an adjustment device for an electronic rearview mirror according to an exemplary embodiment;
[0053] Fig.17 It is a block diagram of a processing device according to an exemplary embodiment. DETAILED DESCRIPTION
[0054] In order to enable ordinary persons in the art to better understand the technical solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the accompanying drawings.
[0055] It should be noted that the terms "first", "second", etc. in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the attached claims.
[0056] With the continuous development of automobile technology, it is becoming a trend to replace traditional outer rearview mirrors with electronic rearview mirrors. Electronic rearview mirrors use cameras placed in the original outer rearview mirror position to obtain the rear view of the vehicle and transmit it to the screen set up in the car. Since the rotation of the camera is more flexible and has a larger rotation angle than the traditional rearview mirror, it greatly reduces the blind spot of the field of vision. It can also reduce the width of the vehicle and reduce the wind resistance of the vehicle when driving, thereby improving the performance of the vehicle to a certain extent.
[0057] However, electronic rearview mirrors also have some defects, such as: the image is fixed. When people who are accustomed to using optical rearview mirrors need to adjust the field of view when using electronic rearview mirrors, they cannot adjust the field of view or viewing angle by adjusting the observation position.
[0058] In order to solve the above technical problems, the present application provides an adjustment method for an electronic rearview mirror, comprising: determining an offset distance and an offset direction between a current position of a driver's head of a vehicle and a reference position. When the electronic rearview mirror is in an angle adjustment mode and the offset direction is a target direction, determining an adjustment angle of a camera of the electronic rearview mirror of the vehicle according to the offset distance, and adjusting the camera of the electronic rearview mirror according to the adjustment angle.
[0059] In this way, when the position of the driver's head changes, the offset distance of the current position of the driver's head compared to the reference position is calculated. Subsequently, when the electronic rearview mirror is in the angle adjustment mode, the adjustment angle of the camera of the electronic rearview mirror is determined according to the offset distance, and the camera of the electronic rearview mirror is adjusted according to the adjustment angle. In this way, the angle of the camera of the electronic rearview mirror is adjusted according to the change of the driver's head position, and the field of view or viewing angle can be adjusted by adjusting the observation position, so that the angle of the vehicle rearview mirror is automatically adjusted when the electronic rearview mirror needs to be adjusted, so as to facilitate the driver to observe the road conditions and ensure driving safety.
[0060] like Figure 1 As shown, Figure 1 An electronic rearview mirror adjustment system 100 is provided in an embodiment of the present application. The electronic rearview mirror adjustment system 100 may include a vehicle-mounted controller 101 and an electronic rearview mirror 102. The vehicle-mounted controller 101 is in communication connection with the electronic rearview mirror 102.
[0061] The vehicle controller 101 is used to obtain the current position of the driver's head and calculate the offset distance between the current position and the reference position. The vehicle controller 101 is also used to determine the adjustment angle of the camera of the electronic rearview mirror according to the offset distance when the electronic rearview mirror is in an angle adjustment mode, and adjust the camera of the electronic rearview mirror according to the adjustment angle.
[0062] It should be noted that the reference position may be pre-set in the vehicle controller by the maintenance personnel, or may be determined by the vehicle controller 101 according to the position of the driver in the target seat. The target seat is the seat where the driver sits.
[0063] For example, after the driver sits in the target seat of the vehicle, the preset position determination operation is performed. In response to the reference position determination operation, the vehicle controller 101 obtains image information including the driver and calculates the position of the driver's head according to the image information. Subsequently, the calculated position of the driver's head is determined as the preset position.
[0064] In some embodiments, the in-cabin camera collects the coordinates of the driver's head position when observing the rearview mirror display screen in a preset driving posture as a reference position (initial reference value). In order to simplify the algorithm, it is only necessary to construct a spherical body similar to the head according to the envelope of the head rotation.
[0065] The vehicle-mounted controller 101 has image processing capabilities and the ability to adjust the camera angle. The vehicle-mounted controller 101 is used to process image information collected by the camera of the electronic rearview mirror and the camera in the cabin, and output relevant images for display.
[0066] like Figure 2 As shown, a vehicle to which the electronic rearview mirror adjustment system 100 is applied is shown, and the vehicle includes an onboard controller 001, a display screen 002 of the electronic rearview mirror, a camera 003 of the electronic rearview mirror, and an in-cabin camera 004. It should be noted that the onboard controller 001 and the above-mentioned onboard controller 101 are the same device.
[0067] In some embodiments, the video displayed on the display screen 002 of the electronic rearview mirror does not need to change when there is a slight change in the viewing angle. For example, if the driver's head rotation amplitude is less than or equal to the preset amplitude, it will not cause the head position to move. Specifically, the driver's head rotation can be judged using a threshold limit, a filtering algorithm, or an artificial intelligence algorithm to determine whether it is necessary to control the camera to follow the change. This can improve the system robustness and further improve the user experience.
[0068] The in-cabin camera 004 is configured to monitor the position of the driver's head. The in-cabin camera 004 at different positions will affect the way its function is realized and the method of coordinate change. Figure 2 The position of the in-cabin camera 004 shown in FIG. 1 is one setting method.
[0069] In addition, the embodiment of the present application does not limit the number and model of the in-cabin camera 004. The in-cabin camera 004 in the embodiment of the present application can be one or more, and the embodiment of the present application does not limit this.
[0070] Since the specific algorithms and precisions used by single camera and multiple cameras are also different. Multiple cameras arranged in different positions can analyze and calculate the driver's head movement position change information in a more three-dimensional manner, which can further improve its precision and accuracy. The in-cabin camera 004 can be a time of flight (TOF) camera. If the in-cabin camera 004 is a time of flight TOF camera, the bird's-eye-view (BEV) perception can be used to fuse its 3D sensing information to form a more accurate target position representation, further improving the accuracy of image recognition of single camera or multi-camera system.
[0071] In some embodiments, the in-cabin camera 004 is used to collect videos including the driver to analyze and calculate the driver's head position information. The in-cabin camera 004 can be a single camera or multiple cameras, which is not limited in the embodiments of the present application. In the case where the in-cabin camera 004 is a multiple camera, a "stereoscopic image" can be formed through multiple shooting angles to more accurately determine the head position information and eye perspective information. In some embodiments, the in-cabin camera 004 can be combined with a tof camera to measure the 3D scene of the cockpit and the driver's body and head position to improve the position coordinate accuracy of the detection personnel's body, head, etc.
[0072] The vehicle controller 001 is configured to analyze and calculate the video image collected by the in-cabin camera through image processing capabilities and calculate the head position change information and video angle rotation value in combination with other information (such as the position information of the driver's seat). The vehicle controller 001 is configured to control the movement of the electronic rearview mirror camera servo system or the movement of the virtual servo system (intercepting the translation movement of the video image).
[0073] The camera 003 of the electronic rearview mirror can adopt a single camera or multiple cameras according to different needs and different performance requirements such as field of view, detection distance, etc. The embodiment of the present application does not specifically limit the position of the camera 003. The camera 003 can be set at a conventional electronic rearview mirror position, and can also be set at other positions. The camera 003 in the embodiment of the present application can realize the rearview mirror function, and can also realize the shooting of the scenery outside the car, the shooting of the environment, and other intelligent functions.
[0074] In some embodiments, the camera 003 of the electronic rearview mirror can be a camera of a dual-axis servo system, or a fixed camera, and the embodiment of the present application does not specifically limit the number and type of the camera 003. The camera 003 can be a fixed-focus camera, or a focal length adjustable camera, such as an electronic focus camera, and the embodiment of the present application does not limit this.
[0075] In the embodiment of the present application, the vehicle may further include an inertial sensor.
[0076] An inertial sensor is used to detect the pitch angle state (angle, angular velocity, angular acceleration) or heading angle state (angle, angular velocity, angular acceleration) changes within a certain range of the vehicle body or rearview mirror of a vehicle. Generally, the inertial sensor detects angular acceleration changes. Further, the corresponding angular velocity or angle changes are obtained through integral calculation.
[0077] As Figure 3 shown, it shows that the pitch or heading change state quantity of the bumpy camera is G( Figure 3 For the sake of easy expression, G is represented as an angle in , but actually G can be a state change quantity such as angular velocity or angular acceleration, which can be understood as a change trend). The vehicle-mounted controller 001 calculates the compensation value W = -hG + k. Among them, L < W < M. h and k are positive numbers. L and M limit the range of the W compensation amount, so that the rotation angle of the rearview mirror is within a reasonable range. The above are all for better realizing control or calibration to obtain better effects. The control servo system is implemented to perform corresponding state compensation through the calculated compensation value, and then anti-shake and anti-bump are realized.
[0078] In addition, if the camera 003 is a fixed camera, electronic anti-shake compensation is performed according to the compensation value, and the next frame image display part is reversely offset according to the compensation value. The electronic anti-shake compensation can also not rely on the inertial sensor but identify the same part in the center of the front and rear two frames of images through image processing, and crop off the different parts at the edges. However, there will be a display delay in the image processing process, and it is necessary to meet the delay requirement within the range to ensure safety.
[0079] The above compensation calculation can perform angle, angular velocity or angular acceleration compensation according to system requirements. Through the above control process, Figure 3 the movement amount of the electronic rearview mirror video image caused by bumps shown in will return to the original position through the compensation amount W. In this way, by detecting the attitude change amounts of pitch and heading, the servo or electronic system performs reverse compensation according to the compensation value calculated by the system, and then realizes the anti-shake and anti-bump of the rearview mirror.
[0080] It should be noted that the inertial sensor can be located in the vehicle-mounted controller 001 according to requirements, or in the camera 002, or exist alone, or share sensors at other positions of the vehicle. The embodiments of the present application do not make any limitations in this regard. L, M, h, and k are preset in the vehicle-mounted controller 001 by the operation and maintenance personnel, and the embodiments of the present application do not make specific limitations on the values of L, M, h, and k.
[0081] For the sake of easy understanding, the adjustment method of the electronic rearview mirror provided by the present application will be specifically introduced below in conjunction with the accompanying drawings.
[0082] Figure 4A flow chart of a method for adjusting an electronic rearview mirror according to an exemplary embodiment is shown as follows: Figure 4 As shown, the adjustment method of the electronic rearview mirror includes: S201-S203.
[0083] S201. Determine an offset distance and an offset direction between a current position of a driver's head of a vehicle and a reference position.
[0084] As a possible implementation method, the vehicle controller determines the current position of the driver's head based on the image information of the driver collected by the in-cabin camera. Further, the vehicle controller determines the offset distance between the current position of the driver's head and the reference position.
[0085] As another possible implementation method, the vehicle controller determines the current position of the driver's head based on the image information of the driver collected by the in-cabin camera and the position information of the driver's cabin.
[0086] In some embodiments, the onboard controller calculates an offset distance between a current position of the driver's head and a reference position in a first direction.
[0087] For example, taking the upward displacement of the driver's head as an example, the onboard controller calculates the upward displacement distance of the current position of the driver's head compared to the reference position.
[0088] For example, taking the case where the driver's head is offset to the left, the onboard controller calculates the offset distance of the current position of the driver's head to the left compared to the reference position.
[0089] For example, taking the driver's head shifting to the upper left as an example, the vehicle controller calculates a first offset distance to the left of the current position of the driver's head compared to the reference position, and calculates a second offset distance upward of the current position of the driver's head compared to the reference position.
[0090] In some embodiments, before calculating the offset distance between the current position and the preset position, a reference position is set in the vehicle controller.
[0091] It should be noted that when the driver moves his head to a certain extent to observe the electronic rearview mirror display (taking the left side as an example), and this movement is recognized and captured by the camera in the cabin, the image processing and calculation function of the on-board controller uses a deep learning algorithm to convert the two-dimensional image of the head captured by the camera into three-dimensional space coordinates. The details are omitted during the conversion process, and only a spherical model of the head is needed, without the need for specific facial features, etc., which greatly simplifies the algorithm and reduces the computing power requirements.
[0092] like Figure 5 As shown in FIG, the head rotation and the moving distance X of the movement center in the X direction are calculated based on the coordinate change of the driver's head. Figure 6 As shown in FIG, the head rotation and the moving distance H of the movement center in the H direction are calculated based on the coordinate change of the driver's head. Figure 7 As shown, the head rotation and the movement distance Y of the movement center in the Y direction are calculated based on the coordinate changes of the driver's head.
[0093] It should be noted that the reference position may be the position of the driver's head when the camera of the electronic rearview mirror was adjusted last time. If the camera of the electronic rearview mirror is adjusted for the first time after the vehicle is started, the reference position is the position pre-set by the operator or the driver.
[0094] Understandable, such as Figure 8 As shown, the display angle and field of view required for the driver to observe the current left and right rearview mirror display screens in the normal position are set as the preset position. The driver can normally observe the side and rear images of the vehicle in the preset position.
[0095] S202: When the electronic rearview mirror is in an angle adjustment mode and the offset direction is a target direction, determining an adjustment angle of a camera of the electronic rearview mirror according to an offset distance.
[0096] As a possible implementation method, the vehicle controller obtains the adjustment mode of the electronic rearview mirror when the offset distance is calculated. When the electronic rearview mirror is in the angle adjustment mode and the offset direction is the target direction, the adjustment angle of the camera of the electronic rearview mirror is determined according to the offset distance.
[0097] In some embodiments, when the vehicle controller calculates the offset distance, it determines whether the offset distance is greater than or equal to a preset adjustment threshold, and obtains the adjustment mode of the electronic rearview mirror when the offset distance is greater than or equal to the preset adjustment threshold.
[0098] In some embodiments, the vehicle controller determines the adjustment angle of the camera of the electronic rearview mirror according to the offset distance, the maximum adjustment angle and the preset offset limit.
[0099] In some embodiments, the vehicle controller determines an initial adjustment angle based on the offset distance, the maximum adjustment angle, and a preset offset limit, and corrects the initial adjustment angle based on a correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror.
[0100] In other embodiments, when the vehicle corresponding to the electronic rearview mirror is in a merging or turning state, the vehicle-mounted controller determines the initial adjustment angle based on the offset distance, the maximum adjustment angle and the preset offset extreme value, and corrects the initial adjustment angle based on the correction coefficient and the step parameter to determine the adjustment angle of the camera of the electronic rearview mirror.
[0101] In some embodiments, during the initial setting, the driver's head will move to a certain extent when normally observing the left and right rearview mirrors in addition to the rotational movement. This process is also a range for detecting such small position movements of personnel. Within this range, the rearview mirrors can be optionally not dynamically adjusted. This range can be calibrated Δα. The two-dimensional image is transformed into a three-dimensional model through image acquisition by the camera in the cabin to form a BEV space. When the head turns to observe the left and right rearview mirrors, the rotation and movement center of a spherical head body is constructed through image recognition. In this way, according to the setting Δα and the reference position of the driver's head, the image on the display screen will not move when the head moves X, Y, or H less than Δα in the X, Y, and H directions.
[0102] It should be noted that the maximum adjustment angle, preset adjustment threshold and preset offset limit are preset by the operation and maintenance personnel. For example, the maximum moving distance range of the head in the X and H directions is M. X 、M H The maximum available range of the servo rotation angle of the camera preset direction of the electronic rearview mirror is A MAX .
[0103] It can be understood that the angle adjustment mode is a mode for adjusting the camera angle of the electronic rearview mirror. If the offset distance is less than the preset adjustment threshold, the display content of the current electronic rearview mirror is not adjusted. In this way, frequent adjustment of the display content of the display screen is avoided.
[0104] S203: adjusting the camera of the electronic rearview mirror according to the adjustment angle.
[0105] As a possible implementation method, the vehicle-mounted controller adjusts the camera of the electronic rearview mirror according to the adjustment angle after determining the adjustment angle, so that the camera of the electronic rearview mirror is adjusted to the target position.
[0106] In some embodiments, the vehicle controller determines the adjustment angle and direction of the camera of the electronic rearview mirror according to the offset direction and adjustment angle of the driver's head, and adjusts the camera of the electronic rearview mirror according to the adjustment angle and adjustment direction of the camera of the electronic rearview mirror.
[0107] For example, if the adjustment angle of the electronic rearview mirror is 5° and the adjustment direction is downward adjustment, the vehicle controller adjusts the camera of the electronic rearview mirror downward by 5°.
[0108] For example, if the electronic rearview mirror is adjusted upward by 3° and to the left by 4°, the vehicle-mounted controller adjusts the camera of the electronic rearview mirror upward by 3° and to the left by 4°.
[0109] It can be understood that when the electronic rearview mirror is in the angle adjustment mode, while adjusting the camera of the electronic rearview mirror, the display content of the display screen of the electronic rearview mirror also changes with the angle change of the camera of the electronic rearview mirror.
[0110] The adjustment method provided in the embodiment of the present application brings at least the following beneficial effects: when the position of the driver's head changes, the offset distance of the current position of the driver's head compared to the reference position is calculated. Alternatively, when the electronic rearview mirror is in the angle adjustment mode, the adjustment angle of the camera of the electronic rearview mirror is determined according to the offset distance, and the camera of the electronic rearview mirror is adjusted according to the adjustment angle. In this way, the angle of the camera of the electronic rearview mirror is adjusted according to the change of the driver's head position, and the field of view or viewing angle can be adjusted by adjusting the observation position, so that the angle of the vehicle rearview mirror is automatically adjusted when the rearview mirror needs to be adjusted, so as to facilitate the driver to observe the road conditions and ensure driving safety.
[0111] In one design, in order to simplify the complexity of calculating the adjustment angle of the camera of the electronic rearview mirror and save computing power, the above S202 includes: S2021.
[0112] S2021. When the offset direction is the target direction, determine the adjustment angle of the camera of the electronic rearview mirror according to the offset distance, the maximum offset angle corresponding to the camera in the offset direction, and the preset offset extreme value corresponding to the driver's head.
[0113] For example, the maximum moving distance of the head in the X and H directions is M. X 、M H , the maximum available range of the servo rotation angle of the camera in a certain direction is A MAX Then γ=A MAX / M,(M X or M H ) then the servo needs to rotate proportionally to A = γ X *X or γ H *H.
[0114] It is understandable that only the x and h directions are used to adjust the rotation angle of the image. The maximum adjustment angle is set in advance for the camera of each electronic rearview mirror in each direction, and a preset offset extreme value is set for the driver's head.
[0115] The above S203 includes: S2031.
[0116] S2031. Adjust the camera of the electronic rearview mirror according to the adjustment angle and the offset direction.
[0117] In some embodiments, the vehicle-mounted controller determines the adjustment direction of the camera of the electronic rearview mirror according to the offset direction of the driver's head and the adjustment angle, and adjusts the camera of the electronic rearview mirror according to the adjustment direction and the adjustment angle.
[0118] In one design, the target direction is a horizontal direction or a vertical direction. The horizontal direction is the direction in which the driver's head moves left and right, and the vertical direction is the direction in which the driver's head moves up and down.
[0119] In some embodiments, if the offset direction is horizontal, the camera of the electronic rearview mirror is adjusted in the horizontal direction; if the offset direction is vertical, the camera of the electronic rearview mirror is adjusted in the vertical direction. If the driver's head is offset in both the horizontal and vertical directions, the camera of the electronic rearview mirror is adjusted in the horizontal and vertical directions.
[0120] It should be noted that the driver's head is offset in both the horizontal and vertical directions. The on-board controller can control the camera of the electronic rearview mirror to adjust in the horizontal direction first, can control the camera of the electronic rearview mirror to adjust in the vertical direction, and can also control the camera of the electronic rearview mirror to adjust in both the vertical and horizontal directions at the same time.
[0121] It can be understood that in the embodiment of the present application, the offset distance of the driver's head in the horizontal direction and the vertical direction are calculated respectively, and then the adjustment angle of the camera of the electronic rearview mirror in the horizontal direction and the vertical direction is calculated. In this way, the calculation method is simple and the adjustment effect is more accurate.
[0122] In one design, in order to improve the adjustment accuracy of the camera of the electronic rearview mirror, the above S2021 includes: S301-S302.
[0123] S301: Determine an initial adjustment angle according to an offset distance, a maximum adjustment angle, and a preset offset extreme value.
[0124] The initial adjustment angle is the product of the offset distance and the unit adjustment angle, and the unit adjustment angle is the ratio of the maximum adjustment angle to the preset offset extreme value.
[0125] S302: Correct the initial adjustment angle according to the correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror.
[0126] For example, Fig. 9 as well as Fig.10 The curves of the adjustment angle A" are shown respectively when the correction coefficient a is different. Fig. 9 This is the variation curve of A” when the correction coefficient a is a constant. Fig.10 The changing curve of A” when a is the variable.
[0127] Among them, Fig. 9 In the figure, the constant speed adjustment line L1 indicates that as the geometric rotation value A changes, a equals 1, and the change of A” is equal to the change of A. For the overspeed adjustment line L2, a>1, the change of A” is greater than the change of A, and for the deceleration adjustment line L3, a<1, the change of A” is less than the change of A”. The calibration of the constant coefficient line is to adjust the a value in the above-mentioned integral mapping relationship A”=aA+b in the software according to actual needs until the performance and experience requirements are met, thereby determining the a value. Among them, the b value is the preset adjustment angle, which can also be called a step parameter.
[0128] Fig.10 It can be seen from the variable coefficient curve that there can be an overspeed-reduction coefficient L4, a reduction-overspeed coefficient L5, and a free speed coefficient L6. The variable coefficient a=f(A), where f(A) is a function. The f(A) function is generally determined by first calibrating the a value under a certain amount of initial adjustment angle A value, and then fitting the data according to the a value to form a function of a=f(A). A one-dimensional map table can also be calculated based on the fitting function a=f(A). In actual use, the current demand coefficient a value is calculated based on the a=f(A) function or searched and interpolated based on the map table.
[0129] It should be noted that the variable coefficient a=f(A) is preset by the operation and maintenance personnel, and the embodiment of the present application does not specifically limit the variable coefficient.
[0130] In other embodiments, the selection and calculation of the step parameter b value is also determined according to the driver's experience requirements. When the vehicle corresponding to the electronic rearview mirror is in a merging or turning state, Fig.11 As shown, the b value represents the step attribute of A" in the mapping relationship. It can be understood that in general, b = 0, so that the mapping relationship of A" relative to A does not jump during operation, and the experience is better.
[0131] In one design, in order to improve the adjustment accuracy of the camera of the electronic rearview mirror, when the vehicle corresponding to the electronic rearview mirror is in a merging or turning state, the above S302 includes: S3021.
[0132] S3021. Determine the sum of the intermediate adjustment angle and the preset adjustment angle as the adjustment angle of the camera of the electronic rearview mirror.
[0133] The intermediate adjustment angle is the product of the correction coefficient and the initial adjustment angle.
[0134] In some embodiments, when the vehicle-mounted controller determines the initial adjustment angle, the initial adjustment angle is input into the whole mapping relationship A″=aA+b. Wherein, a is the correction coefficient and b is the preset adjustment angle.
[0135] It should be noted that the preset adjustment angle is pre-set in the vehicle controller by the operation and maintenance personnel. The preset adjustment angle can be set to 5° or 6°. This embodiment of the present application does not make any specific limitation on this.
[0136] In one design, in order to adjust the field of view or viewing angle by adjusting the observation position, thereby automatically adjusting the angle of the vehicle's rearview mirror when the rearview mirror needs to be adjusted, so as to facilitate the driver to observe road conditions and ensure driving safety, the adjustment method provided in the embodiment of the present application also includes: S204-S205.
[0137] S204: When the electronic rearview mirror is in a display content adjustment mode, determine the number of adjustment pixels according to the offset distance and the number of unit pixels.
[0138] The unit pixel number is used to represent the number of pixels corresponding to the unit offset distance.
[0139] In some embodiments, when determining the offset distance, the on-board controller determines the number of adjusted pixels by multiplying the offset distance and the number of unit pixels.
[0140] In other embodiments, when the electronic rearview mirror is in the display content adjustment mode, the adjustment angle of the display content of the display screen is determined according to the offset distance, the maximum adjustment angle, and the preset offset extreme value. The vehicle controller determines the number of adjustment pixels according to the adjustment angle, the maximum viewing angle of the rearview mirror display screen, and the available pixel width of the electronic rearview mirror camera.
[0141] It should be noted that in the embodiment of the present application, the adjustment angle can be determined by referring to the above S201, S202 and S301-S302.
[0142] In some embodiments, when the driver's head is offset, the portion of the video captured by the camera of the electronic rearview mirror is offset accordingly, which can be regarded as a virtual rotation of the camera. Fig.12 Indicates that the offset D of the intercepted portion of the video display = the virtual rotation angle A of the camera rotation v The video part needs to be captured later. The offset D is generally expressed in pixels, and the angle and pixel capture conversion process involves rounding and normalization.
[0143] In some embodiments, the onboard controller calculates the offset distance (movement distance value) in the focus direction and associates the offset distance with the pixel offset. Figure 5 , Figure 6 as well as Figure 7The maximum moving distance range of the head in the x and h directions (a range determined by the display viewing angle range, the head movable range, the camera viewing angle range in the cabin, etc.) is M X 、M H The maximum available range of the number of pixels that can be moved in the target direction of the camera is JMAX, JMAX = the number of camera pixels - the number of pixels of the display interception part, then μ = JMAX (image width or height) / M. Where M can be M X or M H , which can be M X The average value of MH can also be other values set by the operation and maintenance personnel, which is not limited in the embodiments of the present application.
[0144] The amount of pixel shift is D = μ X *X or D = μ H *H. X is obtained when M is MX in μ=JMAX / M, μ H For M in μ = JMAX / M, H Got it.
[0145] In addition, in order to improve the accuracy of the pixel offset, the pixel offset may be corrected after obtaining the pixel offset amount D to obtain a corrected pixel offset.
[0146] For example, the pixel offset amount D is substituted into D″=a1D+b1. Wherein, D″ is the corrected pixel offset amount. a1 is the pixel correction coefficient, and b1 is the pixel correction parameter. The embodiment of the present application does not specifically limit a1 and b1.
[0147] It should be noted that JMAX in the embodiment of the present application can be processed uniformly or separately on the left and right sides or the top and bottom sides of the image when the number of pixels used for adjustment on the left and right sides or the top and bottom sides of the image is not symmetrical, and the embodiment of the present application does not limit this. X and M H It is a positive number pre-set by the operation and maintenance personnel or the driver, and the embodiments of the present application do not make any specific limitation on this.
[0148] It is understandable that the virtual rotation angle A of the camera of the electronic rearview mirror v (Adjustment angle) can be determined by selecting a linear or nonlinear coefficient a and a preset adjustment angle b. Due to the unequal angle relationship, the experience can be improved in some scenarios, such as the visual range can be larger than expected, avoiding the appearance of blind spots, etc.
[0149] S205: Adjust the display content of the display screen according to the adjusted pixel number.
[0150] In one design, in order to accurately adjust the camera of the electronic rearview mirror, the adjustment method provided in the embodiment of the present application includes: S206-S207.
[0151] S206: Obtain image information of the seat where the driver is currently located.
[0152] In some embodiments, the vehicle controller obtains image information of the current driver's seat captured by the in-cabin camera, wherein the image information includes the preset position of the seat and the driver's head.
[0153] If a manual is required, the preset position may be pre-set by the operation and maintenance personnel. The preset position may be the headrest of the seat or the backrest of the seat. This embodiment of the present application does not limit this.
[0154] S207: Determine the initial position of the driver's head and the initial position of the seat according to the image information, and calculate the deviation value between the initial position of the seat and the actual position of the seat.
[0155] In some embodiments, the vehicle controller determines the initial position of the driver's head and the initial position of the preset position of the seat according to the image information. Further, the vehicle controller determines the initial position of the preset position and the actual position deviation value of the preset position.
[0156] Exemplarily, the preset position is a headrest portion of the seat. The vehicle-mounted controller calculates the initial position of the headrest portion of the seat and the deviation value of the actual position.
[0157] It can be understood that the deviation value between the initial position of the seat and the actual position of the seat can be understood as the deviation value of the driver's head position calculated by the on-board controller.
[0158] S208. Correct the initial position according to the deviation value to obtain the current position of the driver's head.
[0159] In some embodiments, after determining the deviation value, the onboard controller obtains the current position of the driver's head based on the initial position of the driver's head according to the deviation value.
[0160] It is understandable that the use of seat position information can also assist in calculating and analyzing the driver's head position.
[0161] If the onboard controller only uses the driver's head image information captured by the in-cabin camera to analyze and calculate its position, it can only analyze and calculate the change in relative position based on the pixel change. In this case, there is a possibility of errors in accuracy and precision.
[0162] In order to improve the accuracy of the position determination of the head of the driving platform, the seat position is comprehensively considered. If there is the position information of each controllable component of the driver's seat, combined with the relative position relationship between the seat position, the driver's body and the head image, its absolute position information in the cockpit can be analyzed and calculated, which can improve the calculation precision and accuracy.
[0163] Among them, the position coordinates of the seat are fixed relative to the display screen after adjustment. A seat identification position is set, and its standard coordinate value can be represented as W. The position coordinates of the seat are also fixed relative to the position of the camera in the cabin after adjustment. The on-board controller can calculate the coordinate value T of the seat identification position relative to the virtual light reflection surface every time it processes the image collected by the camera in the cabin. The difference WT between this coordinate value and the standard coordinate value is the system error of the entire image processing system. This value can be used to compensate for the system error and improve accuracy. Although the physical position relationship of other markers in the cabin is fixed and can also compensate for the system error, the correlation between the seat position and the torso and head is stronger; and because the deviation between the torso and head coordinates and the seat position is limited by the human body size, the maximum deviation threshold can be set manually. If the threshold is exceeded during calculation, it can be considered that the collected data and calculated data are wrong and will not be accepted.
[0164] In some embodiments, the present application can also dynamically adjust the image display size according to the viewing distance of the person, that is, dynamically adjust the focal length according to the distance of the observer's eyes. Fig.13 As shown, when the distance between the human eye and the display screen changes, that is, when L changes, the in-cabin camera system calculates the head position change value in the y-upward distance through image processing (as mentioned above, it can also be combined with the seat position, the 3D information of the tof camera, etc. for fusion calculation), that is, the head y-upward distance changes by the Y value. Similarly, this method is characterized by only focusing on the head position change in the y-upward direction, thereby greatly simplifying the complexity of the angle detection and calculation of the head position, etc. Then, the corresponding focal length change value is found in the preset mapping relationship (such as the Y value-focal length change value map) or other Y value-focal length change mapping relationships are pre-set. The preset mapping relationship includes multiple Y values and the focal length value corresponding to each Y value. Furthermore, the camera of the electronic rearview mirror performs a corresponding focusing action according to the focal length change value, or the fixed focal length camera performs an electronic focusing action, and the display screen displays the image after the focal length adjustment is completed. The above process forms a closed-loop control, realizes the control closed loop on the differential time slice, and then realizes the function of the electronic rearview mirror displaying the video to continuously follow the movement based on the person's observation distance during the movement of the driver's head and eyes, realizes the dynamic zoom function of the intelligent control electronic rearview mirror, and provides a better experience.
[0165] In some embodiments, when the offset direction is a focus direction, a focal length adjustment value of a camera of an electronic rearview mirror of the vehicle is determined according to the offset distance and the target correspondence, and the focal length of the camera of the electronic rearview mirror is adjusted according to the focal length adjustment value. The adjustment direction is the direction in which the driver's head moves forward and backward, and the target correspondence includes multiple offset distances and the focal length adjustment value corresponding to each of the multiple offset distances.
[0166] In order to better understand the adjustment method provided in the embodiments of the present application, Fig.14 , shows a method for adjusting an electronic rearview mirror, including: S11-S14.
[0167] S11. The in-cabin camera collects a reference image of the driver's head position when the driver observes the display screen of the electronic rearview mirror in a preset driving sitting posture.
[0168] S12: Determine the driver's head position in the reference image as a preset position.
[0169] S13. When the distance between the current position of the driver's head and the preset position is greater than a first preset distance, determine an offset distance between the current position and the reference position.
[0170] It should be noted that the first preset distance is pre-set in the vehicle controller by the operation and maintenance personnel.
[0171] S14, determining an adjustment angle of the camera of the electronic rearview mirror according to the offset distance, and controlling the camera servo rotation of the electronic rearview mirror according to the adjustment angle. Alternatively, determining an adjustment pixel number of the display screen of the electronic rearview mirror according to the offset distance, and offsetting a display portion of the video captured by the camera of the electronic rearview mirror according to the adjustment pixel number.
[0172] Subsequently, the display screen displays the image captured by the camera of the electronic rearview mirror after the rotation, completing a cycle of adjusting the camera of the electronic rearview mirror and the display content of the display screen according to the adjustment of the driver's head position. Subsequently, when the position change of the driver's head is detected again, the position of the camera of the electronic rearview mirror is adjusted.
[0173] Alternatively, the display screen re-captures the display area and displays the captured content. Subsequently, when the position change of the driver's head is detected again, the captured area is adjusted.
[0174] In order to better understand the adjustment method provided in the embodiments of the present application, Fig.15 , shows a method for adjusting an electronic rearview mirror, including: S21-S24.
[0175] S21. The in-cabin camera collects a reference image of the driver's head position when the driver observes the display screen of the electronic rearview mirror in a preset driving sitting posture.
[0176] S22: Determine the driver's head position in the reference image as a preset position.
[0177] S23. When the distance between the current position of the driver's head and the preset position in the focusing direction is greater than a second preset distance, determine the moving distance between the current position and the reference position.
[0178] It should be noted that the focusing direction is in front of or behind the driver, that is, after the driver's head moves forward or backward, the camera of the electronic rearview mirror is focused.
[0179] S24, controlling the camera of the electronic rearview mirror to focus according to the moving distance.
[0180] Subsequently, the display screen displays the image captured by the camera of the electronic rearview mirror after the focus adjustment, completing a cycle of adjusting the focal length of the camera of the electronic rearview mirror according to the position of the driver's head. Subsequently, when the position change of the driver's head is detected again, the focal length of the camera of the electronic rearview mirror is adjusted.
[0181] The adjustment method provided in the embodiment of the present application brings the following beneficial effects: by monitoring the driver's head movement and orientation, the electronic rearview mirror movement can be "remotely controlled"; the displayed image can change with the change of the head movement position. The driver turns on the initial setting function, and the controller collects the image of the driver observing the electronic rearview mirror display screen in a normal sitting position through the in-cabin camera, and records the spatial coordinate parameters of the driver's head position and facial orientation when observing the electronic rearview mirror display screen during normal driving; the above, the initial setting is completed; based on the above head position and facial orientation basic position, if the head is moved at this time, it causes the observation distance between the person's head and the display screen to change, or it can be considered as a front and back change in the head position. The electronic rearview mirror camera dynamically adjusts the camera focal length or electronically adjusts the focus to achieve the follow-up change of the displayed image size at different observation distances, which can improve the observation accuracy and is a smarter observation method. As long as the image transition is adjusted, it will naturally be safer and smarter.
[0182] The above mainly introduces the solution provided by the embodiment of the present application from the perspective of the method. In order to achieve the above functions, the regulating device includes a hardware structure and / or software module corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present application.
[0183] Fig.16 The present invention is an adjustment device for an electronic rearview mirror according to an exemplary embodiment. Fig.16 The electronic rearview mirror adjustment device 40 includes: a determination unit 401 and a processing unit 402. The determination unit 401 is used to determine the offset distance and offset direction between the current position of the driver's head of the vehicle and the reference position. The determination unit 401 is also used to determine the adjustment angle of the camera of the electronic rearview mirror of the vehicle according to the offset distance when the electronic rearview mirror is in an angle adjustment mode and the offset direction is a target direction. The processing unit 402 is used to adjust the camera of the electronic rearview mirror according to the adjustment angle.
[0184] In one possible manner, the determination unit 401 is specifically used to: determine the adjustment angle of the camera of the electronic rearview mirror according to the offset distance, the maximum offset angle corresponding to the camera in the offset direction, and the preset offset extreme value corresponding to the driver's head; adjust the camera of the electronic rearview mirror according to the adjustment angle, including: adjusting the camera of the electronic rearview mirror according to the adjustment angle and the offset direction.
[0185] In one possible approach, the target direction is a horizontal direction or a vertical direction; the horizontal direction is a direction in which the driver's head moves left and right, and the vertical direction is a direction in which the driver's head moves up and down.
[0186] In one possible manner, the determination unit 401 is specifically configured to: determine an initial adjustment angle according to the offset distance, the maximum adjustment angle, and the preset offset extreme value. The initial adjustment angle is the product of the offset distance and the unit adjustment angle, and the unit adjustment angle is the ratio of the maximum adjustment angle to the preset offset extreme value. The initial adjustment angle is corrected according to the correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror.
[0187] In one possible manner, when the vehicle is in a merging or turning state, the determination unit 401 is specifically used to: determine the sum of the intermediate adjustment angle and the preset adjustment angle as the adjustment angle of the camera of the electronic rearview mirror; the intermediate adjustment angle is the product of the correction coefficient and the initial adjustment angle.
[0188] In one possible manner, the determination unit 401 is further configured to determine the number of adjustment pixels according to the offset distance and the number of unit pixels when the electronic rearview mirror is in the display content adjustment mode; the number of unit pixels is used to represent the number of pixels corresponding to the unit offset distance. The processing unit 402 is further configured to adjust the display content of the display screen according to the number of adjustment pixels.
[0189] One possible approach is Fig.16 As shown, the adjustment device 40 also includes: an acquisition unit 403. The acquisition unit 403 is used to acquire image information of the seat where the driver is currently located. The processing unit 402 is also used to determine the initial position of the driver's head and the initial position of the seat according to the image information, calculate the deviation value between the initial position of the seat and the actual position of the seat, and correct the initial position according to the deviation value to obtain the current position of the driver's head.
[0190] Fig.17 FIG. 1 is a block diagram of a processing device according to an exemplary embodiment. Fig.17 As shown, the processing device includes but is not limited to: a processor 501 and a memory 502 .
[0191] The memory 502 is used to store executable instructions of the processor 501. It can be understood that the processor 501 is configured to execute instructions to implement the model training method and SOC estimation method in the above embodiment.
[0192] It should be noted that those skilled in the art can understand that Fig.17 The processing device structure shown in the figure does not constitute a limitation on the processing device, and the processing device may include Fig.17 More or fewer components may be shown, or certain components may be combined, or the components may be arranged differently.
[0193] The processor 501 is the control center of the processing device. It uses various interfaces and lines to connect various parts of the entire processing device. By running or executing software programs and / or modules stored in the memory 502, and calling data stored in the memory 502, it performs various functions of the processing device and processes data, thereby monitoring the processing device as a whole. The processor 501 may include one or more processing units. Optionally, the processor 501 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 501.
[0194] The memory 502 can be used to store software programs and various data. The memory 502 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, an application program required by at least one functional module (such as a determination unit, a processing unit, etc.), etc. In addition, the memory 502 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.
[0195] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 502 including instructions, and the above instructions can be executed by a processor 501 of a processing device to implement the method in the above embodiment.
[0196] Optionally, the computer-readable storage medium may be a non-temporary computer-readable storage medium, for example, the non-temporary computer-readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.
[0197] In an exemplary embodiment, the present application also provides a computer program product including one or more instructions, and the one or more instructions can be executed by the processor 501 of the processing device to complete the method in the above embodiment.
[0198] It should be noted that when the instructions in the above-mentioned computer-readable storage medium or one or more instructions in the computer program product are executed by the processor of the processing device, the various processes of the above-mentioned method embodiment are implemented, and the same technical effect as the above-mentioned method can be achieved. To avoid repetition, they will not be repeated here.
[0199] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0200] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0201] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.
[0202] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0203] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or the full classification part or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium, including a number of instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute the full classification part or part of the steps of each embodiment method of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, ROM, RAM, disk or CD and other media that can store program code.
[0204] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto, and any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. A method for adjusting an electronic rearview mirror, characterized in that: include: Determining an offset distance and an offset direction between a current position of a driver's head of the vehicle and a reference position; When the electronic rearview mirror is in an angle adjustment mode and the offset direction is a target direction, an adjustment angle of a camera of the electronic rearview mirror of the vehicle is determined according to the offset distance, and the camera of the electronic rearview mirror is adjusted according to the adjustment angle.
2. The adjustment method according to claim 1, characterized in that: The step of determining the adjustment angle of the camera of the electronic rearview mirror according to the offset distance includes: Determining an adjustment angle of the camera of the electronic rearview mirror according to the offset distance, a maximum offset angle corresponding to the camera in the offset direction, and a preset offset extreme value corresponding to the driver's head; The method of adjusting the camera of the electronic rearview mirror according to the adjustment angle includes: The camera of the electronic rearview mirror is adjusted according to the adjustment angle and the offset direction.
3. The adjustment method according to claim 2, characterized in that: The target direction is a horizontal direction or a vertical direction; the horizontal direction is a direction in which the driver's head moves left and right, and the vertical direction is a direction in which the driver's head moves up and down.
4. The adjustment method according to claim 2, characterized in that: The step of determining the adjustment angle of the camera of the electronic rearview mirror according to the offset distance, the maximum adjustment angle corresponding to the offset direction, and the preset offset extreme value comprises: Determine an initial adjustment angle according to the offset distance, the maximum adjustment angle and the preset offset extreme value; the initial adjustment angle is the product of the offset distance and the unit adjustment angle, and the unit adjustment angle is the ratio of the maximum adjustment angle to the preset offset extreme value; The initial adjustment angle is corrected according to the correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror.
5. The adjustment method according to claim 4, characterized in that: When the vehicle is in a merging or turning state, the initial adjustment angle is corrected according to the correction coefficient to determine the adjustment angle of the camera of the electronic rearview mirror, including: The sum of the intermediate adjustment angle and the preset adjustment angle is determined as the adjustment angle of the camera of the electronic rearview mirror; the intermediate adjustment angle is the product of the correction coefficient and the initial adjustment angle.
6. The adjustment method according to any one of claims 1 to 5, characterized in that: The method further comprises: When the electronic rearview mirror is in a display content adjustment mode, the number of pixels to be adjusted is determined according to the offset distance and the number of unit pixels; the number of unit pixels is used to represent the number of pixels corresponding to the unit offset distance; The display content of the display screen of the electronic rearview mirror is adjusted according to the adjusted pixel number.
7. The adjustment method according to any one of claims 1 to 5, characterized in that: The method further comprises: Acquire image information of the seat where the driver is currently located; determining the initial position of the driver's head and the initial position of the seat according to the image information, The deviation value between the initial position of the seat and the actual position of the seat is calculated, and the initial position of the driver's head is corrected according to the deviation value to obtain the current position of the driver's head.
8. The adjustment method according to any one of claims 2 to 5, characterized in that: The method further comprises: In the case where the offset direction is a focusing direction, the focal length adjustment value of the camera of the electronic rearview mirror of the vehicle is determined according to the offset distance and the target correspondence, and the focal length of the camera of the electronic rearview mirror is adjusted according to the focal length adjustment value; the adjustment direction is the direction in which the driver's head moves forward and backward, and the target correspondence includes multiple offset distances and the focal length adjustment value corresponding to each of the multiple offset distances.
9. An adjustment device for an electronic rearview mirror, characterized in that: include: Determine the unit and the processing unit; The determination unit is used to determine the offset distance and offset direction between the current position of the driver's head of the vehicle and the reference position; The determining unit is further configured to determine an adjustment angle of a camera of the electronic rearview mirror of the vehicle according to the offset distance when the electronic rearview mirror is in an angle adjustment mode and the offset direction is a target direction; The processing unit is used to adjust the camera of the electronic rearview mirror according to the adjustment angle.
10. An electronic device, characterized in that: including memory and processor; The memory is coupled to the processor; The memory is used to store computer program code, wherein the computer program code includes computer instructions; When the processor executes the computer instructions, the electronic device performs the adjustment method as described in any one of claims 1-8.
11. A computer-readable storage medium, characterized in that: When the computer-executable instructions stored in the computer-readable storage medium are executed by a processor of a processing device, the processing device can perform the adjustment method according to any one of claims 1 to 8.
12. A vehicle, characterized in that: Comprising the electronic device as claimed in claim 10.
Citation Information
Patent Citations
Electronic rearview mirror view switching method, electronic rearview mirror and ECU end
CN117400832A
Cited By
Automatic angle adjusting and angle metering method and equipment for automobile rearview mirror
CN119348545A
