A method and device for intelligently adjusting a rearview mirror
Automatically adjusting the rearview mirror through database and structured light technology, the driving safety and experience problems caused by manual operation in the existing technology are solved, intelligent adjustment without diverting attention is achieved, and driving safety and convenience are improved.
Patent Information
- Application Number
- CN202110989231.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-08-26
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-08-26
AI Technical Summary
The existing car rearview mirror adjustment technology requires manual operation by the driver, which makes it easy to cause safety accidents to divert attention during driving, and the vehicle needs to be re-adjusted when changing the driver or adjusting the seat, affecting the driving experience.
Using intelligent database-based adjustment method, structured light is projected through structured light camera module, face area images are collected, point cloud data is calculated to determine the position of the human eye, and the rearview mirror angle is automatically adjusted in combination with the data stored in the database to achieve intelligent without manual operation. adjust.
Automatically adjust the rearview mirror without diverting the driver's attention, improving driving safety, simplifying the operation process, improving driving experience, and supporting keys, voice and other triggering methods to adapt to different drivers' needs.
Smart Images

Figure CN113635835B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of automobile electronics, and in particular to an adjustment technology for a rearview mirror of a vehicle. Background Art
[0002] The car rearview mirror can provide the driver with a certain range of vision on the side and rear of the car, which plays a very critical role in driving safety.
[0003] As is known to all, in order to adapt to various situations and meet various needs, the existing rearview mirror adjustment technology is based on manual operation, that is, it needs to be manually operated by the driver. However, there are many problems in the actual application of the manual adjustment method.
[0004] For example, if you divert your attention to make manual adjustments while the car is driving, it will be very detrimental to driving safety and can easily cause safety accidents.
[0005] Furthermore, if the driver of the vehicle is changed or the seat is adjusted, the rearview mirror needs to be manually adjusted every time. Each manual adjustment of the rearview mirror takes more than ten seconds to dozens of seconds, and the driver needs to repeatedly confirm the adjustment process based on driving experience, which greatly affects the driving experience of the car.
[0006] With the development and progress of automotive electronic technology, people have higher and higher requirements for the intelligence of automotive electronic products. Under this trend, providing drivers with a simple-to-operate and intelligent automotive rearview mirror adjustment solution is an urgent problem to be solved in this field. Summary of the invention
[0007] In view of the problems existing in the manual adjustment of rearview mirrors on existing vehicles, the purpose of the present invention is to provide a method for intelligently adjusting rearview mirrors, and based on this, the present invention further provides a device for intelligently adjusting rearview mirrors to achieve intelligent and convenient adjustment of vehicle rearview mirrors.
[0008] In order to achieve the above-mentioned purpose, the present invention provides an intelligent adjustment method for rearview mirrors, which is based on a database that stores human eye position data and corresponding rearview mirror angle data. The position of the human eye in the cab space is identified and determined, and the corresponding rearview mirror angle data is directly determined based on the data stored in the database.
[0009] Furthermore, the adjustment method for determining the position of the human eye in the cab space includes:
[0010] By projecting structured light onto the face area of the object to be measured, a structured light image of the area is collected;
[0011] The point cloud data containing the spatial coordinates of the face area is obtained by calculation;
[0012] The spatial coordinates in the point cloud data are transformed into a standard vehicle coordinate system, and the position of the human eyes in the structured light image corresponding to the facial area is calculated to obtain the spatial position data of the human eyes.
[0013] Furthermore, the adjustment method also includes a driver posture judgment step.
[0014] Furthermore, the adjustment method also includes a triggering step of the intelligent adjustment action.
[0015] Furthermore, the adjustment method includes a step of optimizing and upgrading the database.
[0016] Furthermore, the adjustment method includes a step of confirming the intelligent adjustment state of the rearview mirror.
[0017] In order to achieve the above object, the present invention provides a rearview mirror intelligent adjustment device, comprising:
[0018] A data storage module, wherein the data storage module stores eye position data and corresponding rearview mirror angle data;
[0019] A structured light camera module, which actively projects structured light onto the driver's face area to collect a structured light image of the face area;
[0020] A calculation module, wherein the calculation module calculates and determines the position data of the driver's eyes in the cab space based on the data collected by the structured light camera module, determines the corresponding rearview mirror angle data based on the position data according to the data stored in the database, and forms a rearview mirror intelligent adjustment instruction based on the determined rearview mirror angle data.
[0021] Furthermore, after collecting the structured light image of the face area, the structured light camera module obtains point cloud data containing spatial coordinates of the face area through calculation.
[0022] Furthermore, the calculation module transforms the spatial coordinates in the point cloud data obtained by the structured light camera module into a standard vehicle coordinate system, locates the eye position in the structured light image corresponding to the face area by calculation, and then determines the corresponding rearview mirror angle data from the data storage module based on the calculated eye position data.
[0023] Furthermore, the regulating device also includes a communication module, and the communication module establishes a communication channel between the data storage module and the remote server.
[0024] Furthermore, the adjustment device also includes a human-computer interaction module, and the human-computer interaction module performs data interaction with the data storage module, the structured light camera module, and the calculation module.
[0025] Furthermore, the adjustment device also includes a driver posture detection module, and the driver posture detection module interacts with the calculation module to complete the driver posture detection before the intelligent adjustment of the rear-view mirror.
[0026] Furthermore, the regulating device also includes an intelligent trigger mechanism module, and the intelligent trigger mechanism module is configured into two modes: an active trigger mode and / or a passive trigger mode.
[0027] The intelligent adjustment solution for rearview mirrors provided by the present invention can intelligently adjust the rearview mirrors without diverting the driver's attention during the driving of the car, without the need for manual operation by the driver, and effectively solves the driving safety problems caused by manual operation of the driver in the prior art.
[0028] The intelligent adjustment solution for rearview mirrors provided by the present invention can trigger the intelligent adjustment of rearview mirrors in active or passive ways such as buttons, voice, seat adjustment, changing drivers, etc. This is simple and convenient, saves the driver's operation time, and greatly improves the car driving experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0029] The present invention is further described below in conjunction with the accompanying drawings and specific embodiments.
[0030] Figure 1 It is a schematic diagram of the structure of the intelligent adjustment device for rearview mirror in an example of the present invention;
[0031] Figure 2 It is a basic working flow chart of the intelligent adjustment device for rearview mirror in an example of the present invention;
[0032] Figure 3 The figure is a schematic diagram of the triggering operation of the intelligent adjustment device for rearview mirror in an example of the present invention. DETAILED DESCRIPTION
[0033] In order to make the technical means, creative features, objectives and effects achieved by the present invention easy to understand, the present invention is further explained below with reference to specific diagrams.
[0034] In view of the problems caused by the existing manual operation of rearview mirror adjustment, the present invention provides an intelligent adjustment solution for rearview mirrors based on database and human eye positioning technology, so as to realize intelligent and convenient adjustment of rearview mirrors.
[0035] The intelligent adjustment scheme for rearview mirrors provided by the present invention is based on a database storing human eye position data and corresponding rearview mirror angle data. The position of the human eye in the cab space is determined by identification, and the corresponding rearview mirror angle data is directly determined according to the data stored in the database. Then, the rearview mirror is automatically adjusted based on the determined rearview mirror angle data, and the identification of the human eye position, the comparison and determination of the rearview mirror angle data and the adjustment of the rearview mirror are automatically completed without manual participation, and the scheme is safe, reliable and easy to operate.
[0036] See also Figure 1 , which shows an example of the structure of a rearview mirror intelligent adjustment device provided by the present invention that can realize intelligent adjustment of the rearview mirror.
[0037] As can be seen from the figure, the rearview mirror intelligent adjustment device 100 is mainly composed of a data storage module 110, a structured light camera module 120, a calculation module 130, a driver posture detection module 140, a human-computer interaction module 150, a communication module 160 and a rearview mirror drive module 170 that cooperate with each other.
[0038] The data storage module 110 in the device stores the eye position data and the corresponding rearview mirror angle data.
[0039] The eye position data here refers to the spatial position of the eyes of a person in a driving position in a normal driving posture within the vehicle cab.
[0040] The rearview mirror angle data here enables the optimal side and rear views to be obtained from the rearview mirror in a state corresponding to the position of the human eye.
[0041] At the same time, the rearview mirror angle data includes the angle data of the rearview mirrors on both sides of the vehicle.
[0042] As an example, when the data storage module 110 is implemented, it has a built-in factory database, which includes human eye position data and corresponding rearview mirror angle data. The database can be obtained by performing a large amount of data calibration during the solution development stage, but is not limited to this.
[0043] Furthermore, the data in the built-in database of the data storage module 110 can also be optimized and upgraded in actual application through the communication module 160. The specific optimization and upgrading scheme is not described here in detail, and can be determined according to actual needs.
[0044] It should be noted here that, since the angle change of the rearview mirror is directly driven by the rearview mirror driving motor, the rearview mirror angle data stored in the data storage module 110 can be replaced by the rearview mirror driving motor angle data.
[0045] The structured light camera module 120 in the present device is used to collect structured light images of the facial area of a person in a normal driving posture at a driving position, so as to cooperate with the calculation module 130 to complete the determination of the eye position data.
[0046] As an example, the structured light camera module 120 in this example is composed of a structured light depth camera, and the structured light depth camera is preferably set in front of the driver of the vehicle to obtain a structured light image of the driver's face area. The specific setting position of the structured light camera module 120 is not limited here and can be determined according to actual needs. For example, it can be set on the A-pillar of the vehicle facing the driver's face area, or on the rearview mirror in the cab, etc.
[0047] The specific structure of the structured light camera module 120 is not described in detail here and can be determined according to actual needs.
[0048] The structured light camera module 120 provided in this example actively projects structured light to the driver's face area during operation, collects a structured light image of the driver's face area, and obtains point cloud data containing spatial coordinates of the face area through calculation.
[0049] There is no limitation on the specific process of image acquisition and point cloud data calculation here, which can be determined according to actual needs.
[0050] In this way, the structured light camera module 120 also performs data interaction with the calculation module 130 to transmit the collected image data and the calculated point cloud data to the calculation module 130 for calculating the location of the human eye.
[0051] The computing module 130 in the present device is the data processing body of the entire device. The computing module 130 interacts with the structured light camera module 120, the data storage module 110 and the rearview mirror drive module 170 for data. First, it cooperates with the structured light camera module 120 to complete the determination of the human eye position, and then cooperates with the data storage module 110 to complete the determination of the rearview mirror angle data. Finally, it cooperates with the rearview mirror drive module 170 to complete the rearview mirror angle adjustment.
[0052] Specifically, the calculation module 130 obtains the structured light image and the corresponding point cloud data of the driver's face area from the structured light camera module 120, and transforms the spatial coordinates in the point cloud data into a standard vehicle coordinate system; then locates the position of the human eyes in the image through the target detection algorithm, thereby obtaining the spatial position data of the human eyes; then compares the human eye position data with the human eye position data in the data storage module, and calculates the corresponding rearview mirror angle data according to the linear interpolation method.
[0053] It should be noted here that when the calculation module 130 uses a target detection algorithm to calculate the position of the human eye, there is no limitation on the specific target detection algorithm, which can be determined according to actual needs.
[0054] In this example, the target detection algorithm is used to calculate the position of the human eye, which can quickly and accurately identify the human eye in the image and provide the position data; at the same time, combined with the single element characteristics of the vehicle's internal environment, it can greatly improve the recognition accuracy and ensure stable and reliable performance.
[0055] Furthermore, when the calculation module 130 calculates and determines the rearview mirror angle data, it is not limited to using the linear interpolation method, and any other feasible solution can also be used. In this example, the linear interpolation method is used to calculate the rearview mirror angle data, which can reduce the amount of calculation and save computing power for the control chip of the car.
[0056] The specific structure of the calculation module 130 is not described here, and can be determined according to actual needs. As an example, the calculation module 130 can be composed of corresponding PLC, CPU chip, MCU chip and other chip modules with calculation functions. It can be set independently or directly implemented by the vehicle's onboard chip.
[0057] The driver posture detection module 140 in the present device exchanges data with the calculation module 130 to complete the driver posture detection before the intelligent adjustment of the rearview mirror, thereby judging the normal driving sitting posture of the driver, thereby improving the accuracy of the data collected by the structured light camera module 120, and then ensuring the accuracy of the calculation module 130 in calculating the human eye position and determining the angle of the rearview mirror.
[0058] At the same time, the driver posture is detected by the driver posture detection module 140, which can also be used as a trigger start signal for the adjustment device to start automatic adjustment. That is, after determining that the driver posture belongs to the normal driving sitting posture, the adjustment device starts to trigger and start, and performs structured light image acquisition of the face area, subsequent human eye positioning calculation and rearview mirror adjustment, etc., to avoid false triggering of the device and further ensure the reliability of the device.
[0059] As an example, in order to accurately detect and determine the driver's posture, the driver posture detection module 140 in this example is mainly composed of a seat belt buckle switch detection module 141 and a seat state detection module 142 that cooperate with each other.
[0060] The seat belt buckle switch detection module 141 is used to detect the seat belt buckle switch information and identify whether the seat belt at the driving position is correctly worn.
[0061] In this example, there is no limitation on the specific configuration of the seat belt buckle switch detection module 141, which can be determined according to actual needs, as long as the seat belt buckle switch information can be detected quickly and accurately.
[0062] The seat status detection module 142 here is used to detect seat status information, including seat movement information, seat occupancy information, etc., that is, to detect and determine whether the seat position is adjusted, whether the driver leaves the seat, etc.
[0063] In this example, the specific configuration of the seat state detection module 142 is not limited and can be determined according to actual needs. For example, the seat state detection module 142 can be composed of corresponding detection sensors to accurately identify the movement information and / or occupancy information of the seat.
[0064] Thus, the driver posture detection module 140 can transmit the detected data to the calculation module 130 in real time to perform driver posture recognition and judgment.
[0065] In a specific implementation, the driver posture detection module 140 can exchange data with the calculation module 130 in a wired or wireless manner. This is not limited here. As an example, the driver posture detection module 140 can exchange data with the calculation module 130 through the vehicle's own vehicle network 200.
[0066] In this way, the computing module 130 cooperates with the driver posture detection module 140 through the vehicle network, and identifies whether the driver is seated and has fastened his seat belt by collecting the occupancy sensor of the driver's seat and the seat belt buckle switch information; and by collecting the seat position data, the spatial position range of the driver's eyes in a normal driving posture is determined according to the seat position data. If the human eye position data is within this range, it is determined that the driver's posture is a normal driving posture.
[0067] The human-computer interaction module 150 in the device interacts with the data storage module 110, the structured light camera module 120, the computing module 130, the rearview mirror driving module 170, etc. to realize the human-computer interaction function of the device, thereby realizing the intelligent control function of the device by humans.
[0068] The human-computer interaction module 150 here can be implemented in a variety of modes, such as gesture recognition, voice recognition, controls, screen display, etc. The control mode can be implemented by a touch screen or a physical control.
[0069] There is no limitation on the specific configuration of the human-computer interaction module 150 in the present device, and it can be determined according to actual needs.
[0070] For example, when the human-machine interaction module 150 is in operation, it can inform the driver after the intelligent adjustment of the rearview mirror is completed, and ask the driver to confirm whether the angle of the rearview mirror meets the driving requirements. For example, the driver can be informed through an interactive method of instrument display or voice notification, and the driver can confirm through voice or button.
[0071] When the human-machine interaction module 150 receives feedback from the driver confirming that the driving needs are met, the calculation module in the device will record the current human eye position data and the corresponding rearview mirror angle data in the data storage module. If the human-machine interaction module 150 receives feedback from the driver confirming that the driving needs are not met, the calculation module in the device controls the restoration of the position of the rearview mirror before adjustment; if the human-machine interaction module 150 does not receive feedback from the driver, the adjusted rearview mirror state is maintained, but no data is recorded.
[0072] The communication module 160 in the present device performs data interaction with the data storage module 110 , and can establish a communication channel between the data storage module 110 and the remote server 300 , thereby optimizing, upgrading or updating the data stored in the data storage module 110 .
[0073] Here, the communication module 160 may be a wireless communication module, and the specific structure may be determined according to actual needs and is not limited here.
[0074] Based on the wireless communication module 160, the device can perform remote data interaction with a cloud server.
[0075] As an example, the device can perform remote data interaction with the remote cloud server 300 based on the communication module 160, so that the data storage module 110 in the device can regularly upload the newly added user data and user feedback to the remote cloud server 300 through the communication module 160. On this basis, the data in the data storage module can be optimized and upgraded according to the newly added user data and user feedback.
[0076] Based on the optimized and upgraded data, the vehicle factory database or the upgraded local database can be updated through the remote cloud server 300 and the wireless communication module 110, where the database is composed of a data storage module.
[0077] The rearview mirror driving module 170 in the present device interacts with the computing module 130 and the human-computer interaction module 150 to form a control instruction for driving the rearview mirror adjustment motor according to the rearview mirror angle data generated by the computing module or the instruction data of the human-computer interaction module 150, so as to realize driving the rearview mirror motor to adjust the rearview mirror angle.
[0078] As an example, the rearview mirror driving module 170 generates a driving signal corresponding to the rotation angle of the rearview mirror motor according to the rearview mirror angle calculated and determined by the calculation module 130, and transmits the driving signal to the driving motor of the corresponding rearview mirror.
[0079] The specific structure of the rearview mirror driving module 170 is not limited and can be determined according to actual needs as long as it can form accurate adjustment instructions.
[0080] The rearview mirror intelligent adjustment device thus formed, on the basis of the above scheme, further adds a fault diagnosis module in this example to identify and feedback various faults that occur during the intelligent adjustment process of the rearview mirror.
[0081] As an example, when the fault diagnosis module in the present device identifies a fault in the rearview mirror motor or any component of the device, it stops the intelligent adjustment function of the rearview mirror, and when the driver triggers this function actively or passively, it informs the driver through the human-computer interaction module that the current function has been discontinued and the fault location.
[0082] The specific structure of the fault diagnosis module is not limited and can be determined according to actual needs, as long as it can provide timely and accurate feedback on various faults that occur during the intelligent adjustment of the rearview mirror.
[0083] On the basis of the above solution, this example further adds an intelligent trigger mechanism module for the intelligent adjustment function of the rearview mirror intelligent adjustment device.
[0084] The intelligent trigger mechanism module can cooperate with other modules in the device to realize the intelligent triggering of the intelligent adjustment function of the rearview mirror intelligent adjustment device.
[0085] In specific implementation, the intelligent trigger mechanism module can be independently set, or implemented on the basis of other control modules, such as being implemented by a computing module in the device.
[0086] As an example, the intelligent trigger mechanism module may be presented in the form of corresponding intelligent trigger mechanism control software, but is not limited thereto.
[0087] In this example, the intelligent trigger mechanism module is used to configure the rearview mirror intelligent adjustment action of the rearview mirror intelligent adjustment device into two modes: active trigger mode and passive trigger mode.
[0088] In the active trigger mode, an operator (such as a driver) inputs instructions through the human-computer interaction module to trigger the rearview mirror intelligent adjustment device to perform the rearview mirror intelligent adjustment action.
[0089] As an example, the input instructions include:
[0090] (1) The operator presses the corresponding rearview mirror intelligent adjustment button, and the rearview mirror intelligent adjustment device immediately responds and performs the rearview mirror intelligent adjustment action;
[0091] (2) The operator inputs the rearview mirror adjustment command through voice, and the rearview mirror intelligent adjustment device immediately responds to the rearview mirror intelligent adjustment action.
[0092] On this basis, when the driver sends a request for intelligent adjustment of the rearview mirror through the active trigger mode, if the driver's sitting posture is not a normal driving posture, the human-computer interaction module will notify the driver to maintain a normal driving posture through the instrument display or voice warning. The voice warning is only given once, and the instrument display lasts for a certain period of time.
[0093] For passive trigger mode, it includes:
[0094] (1) After the vehicle is powered on (ignition switch is in the ON position), if the driver is in the seat and has fastened his seat belt, the structured light depth camera will be used for face recognition. If the driver is not the same person as the last driving cycle, the intelligent adjustment of the rearview mirror will be triggered;
[0095] (2) If the seat position is adjusted, the intelligent adjustment of the rearview mirror will be triggered only after the seat position data stops changing for a certain period of time;
[0096] (3) If the driver's seat occupancy sensor detects that the driver has left the seat, when the driver re-enters the seat and fastens the seat belt, facial recognition is performed. If it is not the same person as the previous driver, the driver's sitting posture is adjusted to a normal driving posture before the intelligent adjustment of the rearview mirror is triggered.
[0097] In order to further improve the reliability of the device and avoid false triggering of the start-up adjustment function, the present example further configures the rearview mirror intelligent adjustment device equipped with an intelligent trigger mechanism module so that in the event of active or passive triggering, the triggering will only be effective if the following necessary conditions are met at the same time:
[0098] (1) Turn on the vehicle (turn the ignition switch to the ON position);
[0099] (2) The driver has taken his seat;
[0100] (3) The driver's seat belt is fastened;
[0101] (4) The driver maintains a normal driving posture for a certain period of time.
[0102] See also Figure 3 , which shows an implementation example of the intelligent triggering of the rearview mirror intelligent adjustment action by the rearview mirror intelligent adjustment device configured with the intelligent triggering mechanism based on the above-mentioned scheme in this example.
[0103] As shown in the figure, step (1) firstly powers on the vehicle and sets the ignition switch to the ON position;
[0104] Step (2) determines whether the driver is seated and has fastened his seat belt; if not, this round of determination ends without triggering the intelligent adjustment function; if already done, proceeds to step (3);
[0105] Step (3) performs face recognition to determine whether the driver has changed; if not, terminate this round of determination and do not trigger the intelligent adjustment function; if changed, proceed to step (4);
[0106] Step (4) determines whether an active trigger command is received, such as whether a key, voice or gesture command is received; if not, proceed to step (8); if yes, proceed to step (5);
[0107] Step (5) detects and determines whether the driver maintains a normal driving sitting posture for a certain period of time. If so, the intelligent rearview mirror adjustment function is triggered; if not, proceed to step (6);
[0108] Step (6) notifying the driver to maintain a normal driving posture through an instrument display or voice warning;
[0109] Step (7) detects and determines whether the driver maintains a normal driving sitting posture for a certain period of time. If so, the intelligent adjustment function of the rearview mirror is triggered; if not, this round of judgment is terminated and the intelligent adjustment function is not triggered;
[0110] Step (8) detecting and determining whether the position of the driver's seat has changed, if not, proceeding to step (10), if so, proceeding to step (9);
[0111] Step (9) detects and determines whether the driver maintains a normal driving sitting posture for a certain period of time. If so, the intelligent adjustment function of the rearview mirror is triggered; if not, this round of judgment is terminated and the intelligent adjustment function is not triggered;
[0112] Step (10) detects whether the driver has re-taken his seat and fastened his seat belt; if not, this round of determination is terminated and the intelligent adjustment function is not triggered; if yes, proceed to step (11);
[0113] Step (11) performs face recognition to determine whether the driver has changed; if not, terminate this round of judgment and do not trigger the intelligent adjustment function; if changed, proceed to step (12);
[0114] Step (12) detects and determines whether the driver maintains a normal driving sitting posture for a certain period of time. If so, the intelligent adjustment function of the rearview mirror is triggered; if not, this round of judgment is ended and the intelligent adjustment function is not triggered.
[0115] Based on such a triggering mechanism, the device can be safely and reliably triggered intelligently, avoiding any problems caused to the driver by false triggering.
[0116] The following is an example of the basic operation process of the rearview mirror intelligent adjustment device.
[0117] See also Figure 2 , which shows a basic process of operation of the rearview mirror intelligent adjustment device in this example.
[0118] After the device is installed on the corresponding vehicle, it will be in standby mode and will be triggered by the set trigger signal. If a trigger signal of the intelligent adjustment function that meets the requirements is detected, the intelligent adjustment of the vehicle rearview mirror will be started.
[0119] First, the fault diagnosis module in the device diagnoses whether there is a fault in the device and / or the rearview mirror drive motor and other components. If there is a fault, the driver is informed through the human-computer interaction module that the current function has been stopped and the fault location.
[0120] If no fault is found after diagnosis, the structured light depth camera in the device will be used to capture an image of the driver's face area in a normal driving posture.
[0121] Next, the structured light depth camera in the device actively projects structured light to the driver's face area, collects the structured light image of the face area, and obtains the point cloud data containing the spatial coordinates of the face area through calculation.
[0122] Next, the computing module in the device transforms the spatial coordinates in the point cloud data into a standard vehicle coordinate system, and then locates the eye position in the image through the target detection algorithm to obtain the eye spatial position data. The eye position data is then compared with the eye position data in the database, and the corresponding rearview mirror motor angle data is calculated using the linear interpolation method.
[0123] Next, the rearview mirror motor driving module in the device drives the rearview mirror motor to adjust the rearview mirror angle according to the calculated motor angle data.
[0124] Then, after the adjustment is completed, the human-computer interaction module in the device informs the driver through the instrument display or voice notification after the intelligent adjustment of the rearview mirror is completed, and asks the driver to confirm whether the rearview mirror angle meets the driving needs.
[0125] When receiving feedback from the driver confirming that the driving needs are met, the device will record the current human eye position data and the corresponding rearview mirror motor angle data into the data storage module; if receiving feedback from the driver confirming that the driving needs are not met, the rearview mirror will be restored to the position before adjustment; if no feedback from the driver is received, the adjusted rearview mirror state will be maintained, but no data recording will be performed.
[0126] At the same time, during the operation of the device, the data storage module inside it will regularly upload the newly added user data and user feedback to the cloud, so that R&D designers can optimize and upgrade the database based on the newly added user data and user feedback. And then update the vehicle factory database or the upgraded local database through the wireless communication module.
[0127] The rearview mirror intelligent adjustment solution formed by the above example has the following advantages over the prior art:
[0128] (1) Compared with the existing rearview mirror adjustment technology, which requires manual operation by the driver, this method realizes intelligent adjustment of the rearview mirror based on the database and human eye positioning method. The intelligent adjustment of the rearview mirror can be triggered by active or passive methods such as buttons, voice, seat adjustment, and driver change, saving the driver's operation time and being simple and convenient.
[0129] (2) Compared with the existing automobile electric rearview mirror adjustment technology, the driver needs to focus on the manual adjustment of the rearview mirror, first find the corresponding adjustment button or lever, and then repeatedly adjust to obtain a satisfactory side and rear view. The whole process takes a long time. This solution can intelligently adjust the rearview mirror without diverting the driver's attention during the driving process of the car, effectively solving the driving safety problem caused by adjusting the rearview mirror during driving.
[0130] (3) This solution abandons the complex solution of identifying the relative coordinates of the human eye position and the rearview mirror, establishing a mathematical model according to certain rearview mirror field of view specifications, obtaining the angle of the rearview mirror through calculation, and further calculating the corresponding angle of the rearview mirror motor. Instead, this solution innovatively directly stores a database of human eye position data and corresponding rearview mirror motor angle data in the data storage module. The database can be optimized and upgraded through the wireless communication module. By using the database, this part of the complex modeling and calculation process can be omitted. After determining the human eye position data, the rearview mirror motor angle can be obtained directly by searching the corresponding value in the database, which greatly simplifies the implementation complexity of the solution and ensures the reliability and accuracy of the solution.
[0131] (4) This solution can store the data and user feedback generated by users in the actual use of the intelligent adjustment rearview mirror function in the cloud, and optimize and upgrade the database based on user feedback. This can solve the problem of poor actual usage experience of the factory database in actual application.
[0132] (5) This solution uses a structured light depth camera. Compared with the human eye positioning algorithm based on a binocular camera, the human eye positioning algorithm based on a structured light depth camera is relatively simple, which reduces the difficulty of development. At the same time, the positioning accuracy is also improved, which can reach the millimeter level. At the same time, this solution also solves the problem that the binocular camera does not perform well in dim light conditions.
[0133] The above shows and describes the basic principles, main features and advantages of the present invention. It should be understood by those skilled in the art that the present invention is not limited to the above embodiments, and the above embodiments and descriptions are only for explaining the principles of the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention to be protected. The scope of protection of the present invention is defined by the attached claims and their equivalents.
Claims
1. A rearview mirror intelligent adjustment method, characterized in that: The adjustment method first determines the spatial position range of the driver's eyes in a normal driving sitting posture by actively triggering or collecting seat position data according to the seat position data, and if the driver's eye position data is within this range, it is determined that the driver's posture is a normal driving sitting posture, and after determining that the driver is in a normal driving sitting posture, passively triggering and starting the intelligent adjustment of the rearview mirror; Then, the intelligent adjustment of the rearview mirror directly obtains the structured light image and corresponding point cloud data of the driver's face area through structured light camera acquisition, and transforms the spatial coordinates in the point cloud data into the standard vehicle coordinate system. Then, the position of the human eye in the structured light image is located through the target detection algorithm, thereby obtaining the spatial position data of the human eye in the cab space, and then comparing the human eye position data with the human eye position data in the data storage module, and calculating the corresponding rearview mirror angle data according to the linear interpolation method.
2. The rearview mirror intelligent adjustment method according to claim 1, characterized in that: The adjustment method also includes a driver posture judgment step.
3. The rearview mirror intelligent adjustment method according to claim 1, characterized in that: The adjustment method also includes a triggering step of an intelligent adjustment action.
4. The rearview mirror intelligent adjustment method according to claim 1, characterized in that: The adjustment method includes a step of optimizing and upgrading the database.
5. The rearview mirror intelligent adjustment method according to claim 1, characterized in that: The adjustment method includes a step of confirming the intelligent adjustment state of the rearview mirror.
6. Rearview mirror intelligent adjustment device, characterized in that: include: A data storage module, wherein the data storage module stores eye position data and corresponding rearview mirror angle data; A driver posture detection module, wherein the driver posture detection module detects the driver's posture and determines the driver's normal driving sitting posture; by collecting seat position data, the spatial position range of the driver's eyes in the normal driving sitting posture is determined according to the seat position data; if the driver's eye position data is within this range, it is determined that the driver's posture belongs to the normal driving sitting posture; A structured light camera module, which actively projects structured light onto the driver's face area to collect a structured light image of the face area; A calculation module, wherein the calculation module calculates the driver posture detection before the mirror is intelligently adjusted according to the data collected by the driver posture detection module; The calculation module calculates and obtains the structured light image and corresponding point cloud data of the driver's face area based on the data collected by the structured light camera module, and transforms the spatial coordinates in the point cloud data into a standard vehicle coordinate system, and then locates the position of the human eyes in the structured light image through a target detection algorithm, thereby determining the position data of the driver's eyes in the cab space, and based on this position data, determines the corresponding rearview mirror angle data according to the data stored in the database, and forms a rearview mirror intelligent adjustment instruction based on the determined rearview mirror angle data.
7. The rearview mirror intelligent adjustment device according to claim 6, characterized in that: After collecting the structured light image of the face area, the structured light camera module obtains point cloud data containing spatial coordinates of the face area through calculation.
8. The rearview mirror intelligent adjustment device according to claim 7, characterized in that: The calculation module transforms the spatial coordinates in the point cloud data obtained by the structured light camera module into a standard vehicle coordinate system, locates the eye position in the structured light image corresponding to the face area by calculation, and then determines the corresponding rearview mirror angle data from the data storage module based on the calculated eye position data.
9. The intelligent adjustment device for rearview mirror according to claim 6, characterized in that: The regulating device further comprises a communication module, which establishes a communication channel between the data storage module and the remote server.
10. The intelligent adjustment device for rearview mirror according to claim 6, characterized in that: The regulating device further comprises a human-computer interaction module, and the human-computer interaction module performs data interaction with the data storage module, the structured light camera module, and the calculation module.
11. The intelligent adjustment device for rearview mirror according to claim 6, characterized in that: The regulating device further comprises an intelligent trigger mechanism module, and the intelligent trigger mechanism module is configured into two modes: an active trigger mode and / or a passive trigger mode.
