Rearview mirror control method and control device, and vehicle
The control device automatically adjusts rearview mirrors based on user intent and eye position data to improve driving experience and safety by providing optimal viewing angles during state changes.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- YINWANG INTELLIGENT TECHNOLOGIES CO LTD
- Filing Date
- 2023-04-14
- Publication Date
- 2026-04-14
Smart Images

Figure 2026512153000001_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of artificial intelligence technology, and more particularly, to a rearview mirror control method and apparatus, and a vehicle.
Background Art
[0002] The rearview mirror is an important component for the safe driving of a vehicle. When the vehicle is traveling in different driving states, such as forward driving or reverse driving (also referred to as backing), by adjusting the rearview mirror to different positions (or angles) according to the driving state of the vehicle, the user can observe the road conditions and obstacles behind the vehicle from a preferred viewing angle. However, when the vehicle switches between different driving states, the user needs to manually adjust the position of the rearview mirror to obtain a preferred viewing angle in the driving state. This manual adjustment process of the rearview mirror is complicated. In particular, when the driving state frequently switches, the user's driving experience becomes insufficient and affects driving safety.
Summary of the Invention
[0003] Embodiments of this application provide a rearview mirror control method and apparatus, and a vehicle for implementing intelligent adjustment of a rearview mirror in different driving states during the vehicle use process to improve the user experience.
Means for Solving the Problems
[0004] According to a first aspect, an embodiment of this application provides a rearview mirror control method. This method may be executed by a control device (for example, the cockpit controller 110 in the following vehicle 100). The control device may be implemented as a component within the vehicle, such as a chip, a chip system, or another functional module that can call a program to execute the program. For ease of understanding, hereinafter, the method of using the control device as an execution entity will be described.
[0005] For example, the method includes determining that the control device intends to control the vehicle so that the user enters a driving state or to control the vehicle so that the user switches between driving states, the driving states including, for example, forward driving or reverse driving, and intelligently adjusting the rearview mirrors to avoid manual adjustment of the rearview mirrors, which can improve the user's driving experience and driving safety, especially when the user frequently enters or switches between driving states.
[0006] Furthermore, the control device can adjust the rearview mirror to a first target position by referring to the user's control intent regarding the vehicle and the position data of the human eye, thereby matching the position (or angle) of the rearview mirror to the user and providing the user with a preferred field of view.
[0007] The position of the rearview mirror may also refer to the angle of the rearview mirror, and controlling the rearview mirror to adjust its position may also refer to controlling the rearview mirror to adjust its angle.
[0008] For example, the control device may, in response to a braking operation input by the user while the vehicle is in parking gear, determine that the user's intention to control the vehicle is to enter a driving state, and then control the rearview mirrors to adjust to a first target position to match the user's intention to control the vehicle, thereby performing automatic adjustment of the rearview mirrors when the vehicle enters a driving state.
[0009] In another example, the control unit may, in response to a gear shifting operation input by the user, determine that the user's intention to control the vehicle is to change the driving state, where the gear shifting operation is used to switch the vehicle from a first gear to a second gear, where the second gear is either reverse or drive, and the first gear is different from the second gear. Thus, the position of the rearview mirror is controlled to adjust to a first target position, and as a result, the position of the rearview mirror matches the user's intention to control the vehicle to change the driving state, thereby performing automatic adjustment of the rearview mirror when the vehicle changes the driving state.
[0010] For example, if the control intention is to enter a driving state, the control device may control the vehicle's rearview mirrors to adjust to a first position based on human eye position data, or if the control intention is to switch driving states, the control device may control the vehicle's rearview mirrors to adjust to a second position based on human eye position data. If the human eye position is the same, different control intentions correspond to different positions of the rearview mirrors, and as a result, the position of the rearview mirrors is adaptively adjusted for different control intentions, and the adjusted position of the rearview mirrors can be matched to the driver's control intention, providing the driver with a preferred field of view.
[0011] In possible implementations, the control device may acquire the user's eye position data, which is determined based on the collected user image.
[0012] If the control intent is to control the vehicle so that it enters a driving state, the control device may collect user images in response to the user getting into the vehicle. In this way, the control device obtains human eye position data when the vehicle enters a driving state and performs automatic adjustment of the rearview mirrors when the vehicle enters a driving state.
[0013] If the control intent is to control the vehicle to switch driving states, the control device may collect user images when the vehicle is driving in a first gear, the first gear being the vehicle's gear before the driving state is switched. User images are collected when the vehicle is driving in the gear before the switch, and as a result, the control device acquires human eye position data in a timely manner in response to the intent to control the vehicle to switch driving states and performs automatic adjustment of the rearview mirrors when the driving state is switched. In addition, the control device may collect user images when the vehicle switches to a second gear for driving, for example, by using user images at the moment the vehicle switches to the second gear, and by acquiring human eye position data in a timely manner in response to the intent to control the vehicle to switch driving states. This is not limited to the collection of user images based on driving in the first gear.
[0014] In the process of acquiring human eye position data, in a possible implementation, to ensure the validity of the human eye position data, the control device may recognize a user image to acquire the user's head posture information, determine whether the duration for which the user's face is facing a first direction reaches a preset duration based on the head posture information, and determine the human eye position data based on the user image if the duration for which the user's face is facing the first direction reaches a preset duration. This avoids the problem of unstable human eye position data due to changes in the user's eye position along with the head position, thereby enabling the rearview mirror adjustment to provide the user with a preferred field of view.
[0015] If the control intent is to control the vehicle to enter a driving state, the first direction may be the user's forward direction, considering that the user may look in the direction in front of the vehicle when the vehicle starts moving. If the control intent is to control the vehicle to switch driving states, the first direction may be the user's left, left front, right, right rear, or forward direction, considering that the user may look in the rearview mirror inside the vehicle, the left rearview mirror, or the right rearview mirror to switch driving states. In this way, the control device can acquire valid human eye position data.
[0016] In the process of acquiring human eye position data, in order to ensure the validity of the human eye position data, in possible implementations, the human eye position data is determined based on the user image if the seat in which the user is sitting is not adjusted during a first period, where the first period is the duration of user image collection.
[0017] In possible implementations, if the control device is unable to obtain human eye position data, the control device may display prompt information to indicate that the duration for which the user's face is facing a first direction has reached a preset duration, and / or to indicate to the user to stop adjusting the seat in which the user is sitting. In this way, the control device can obtain valid human eye position data in time to accurately adjust the rearview mirror.
[0018] In some scenarios, gear changes may be performed multiple times in a short period of time. For example, when a vehicle is performing reverse parking, the gears may be changed multiple times to adjust the vehicle's direction, or the driver may perform multiple quick gear changes due to incorrect gear control. In this case, there is no need to frequently adjust the rearview mirrors. For example, when a vehicle is performing reverse parking, even if the vehicle switches from reverse driving to forward driving, the rearview mirrors may remain in the position corresponding to the reverse driving state and do not need to be changed frequently. Therefore, in this embodiment, when the control device determines that the vehicle speed is above a speed threshold, it may control the vehicle's rearview mirrors to adjust to a first target position based on the control intent and human eye position data, thereby avoiding controlling the rearview mirrors to perform unnecessary position adjustments.
[0019] In possible implementations, the control device determines the discrepancy between a first target position and the current position of the rearview mirror based on the control intent and human eye position data, and controls the vehicle's rearview mirror to adjust to the first target position if the discrepancy is greater than or equal to a discrepancy threshold. If the discrepancy between the first target position and the current position of the rearview mirror is large, the rearview mirror is adjusted, thereby avoiding the high overhead of the control device due to frequent adjustment of the rearview mirror.
[0020] To further improve the convenience of vehicle use and driving safety, the control device may acquire a first adjustment command input by the user, the first adjustment command instructing the vehicle's rearview mirrors to be adjusted, and the control device may adjust the rearview mirrors to a second target position based on the first adjustment command and human eye position data.
[0021] To further fine-tune the rearview mirror and enable adjustment to meet the user's requirements, the control device receives a second adjustment command entered by the user within a preset time after receiving a first adjustment command, the second adjustment command commands the vehicle's rearview mirror to adjust in the target direction, and based on the second adjustment command, controls the rearview mirror to adjust from a second target position to a third target position in the target direction.
[0022] Optionally, the first adjustment command and / or the second adjustment command may include a command entered by the user via audio data (voice-controlled command), or the first adjustment command and / or the second adjustment command may include a command entered by the user by operating a physical button. When the adjustment command is entered by the user via audio data, better human-machine interaction convenience is provided. When the adjustment command is entered by the user by operating a physical button, the reliability of the operation is higher.
[0023] In possible implementations, the control device may determine which rearview mirror to adjust based on the user's head posture information, resulting in the control of one or more of multiple rearview mirrors, thereby improving the flexibility of adjusting the rearview mirrors.
[0024] According to a second aspect, one embodiment of the present application provides a control device, the control device comprising: a processing unit configured to determine a user's control intent to a vehicle, wherein the control intent includes an intent to control the vehicle to enter a driving state or an intent to control the vehicle to switch driving states; and a control unit configured to control the vehicle's rearview mirrors to adjust to a first target position based on the control intent and human eye position data.
[0025] In a possible implementation form, the processing unit is specifically configured to determine that the user's control intention for the vehicle is to enter the driving state in response to a braking operation input by the user when the vehicle is in the parking gear.
[0026] In a possible implementation form, the processing unit is specifically configured to determine that the user's control intention for the vehicle is to switch the driving state in response to a gear shift operation input by the user, where the gear shift operation is used to switch the vehicle from the first gear to the second gear, the second gear is a reverse gear or a drive gear, and the first gear is different from the second gear.
[0027] In a possible implementation form, when the control intention is to enter the driving state, the control unit is specifically configured to control the rearview mirror of the vehicle to be adjusted to the first position based on the position data of the human eyes, or when the control intention is to switch the driving state, the control unit is specifically configured to control the rearview mirror of the vehicle to be adjusted to the second position based on the position data of the human eyes.
[0028] In a possible implementation form, the device further includes an acquisition unit configured to acquire the position data of the user's human eyes, and the position data of the human eyes is determined based on the collected user image.
[0029] In a possible implementation form, the control intention is to control the vehicle to enter the driving state, and the device further includes a collection unit configured to collect a user image in response to the user getting on the vehicle.
[0030] In a possible implementation form, the control intention is to control the vehicle to switch the driving state, and the device further includes a collection unit configured to collect a user image when the vehicle is traveling in the first gear or the second gear, where the first gear is the gear of the vehicle before the driving state is switched, and the second gear is the gear of the vehicle after the driving state is switched.
[0031] In possible implementations, the processing unit is further configured to: recognize a user image to obtain the user's head posture information; determine, based on the head posture information, whether the duration for which the user's face is facing a first direction reaches a preset duration; and, if the duration for which the user's face is facing a first direction reaches a preset duration, determine human eye position data based on the user image.
[0032] In possible implementations, the control intent is to control the vehicle so that it enters a driving state, and the first direction is the user's forward direction.
[0033] In a possible implementation, the processing unit is further configured to determine human eye position data based on a user image if the seat occupied by the user is not adjusted during a first period, where the first period is the duration of user image collection.
[0034] In a possible implementation, the control device further includes a man-machine interaction unit configured to display prompt information if human eye position data is not acquired, the prompt information indicating that the duration for which the user's face is facing a first direction has reached a preset duration, and / or that the adjustment of the seat in which the user is sitting has been stopped.
[0035] In possible implementations, the control intent is to control the vehicle to switch from a reverse driving state to a forward driving state, and the control unit is specifically configured to determine whether the vehicle speed of the vehicle in the forward driving state is above a speed threshold, and if the vehicle speed is above the speed threshold, to control the vehicle's rearview mirror to adjust to a first target position based on the control intent and human eye position data.
[0036] In possible implementations, the control unit is specifically configured to determine the deviation between a first target position and the current position of the rearview mirror based on the control intent and human eye position data, and to control the vehicle's rearview mirror to adjust to the first target position if the deviation is greater than or equal to a deviation threshold.
[0037] In possible implementations, the control unit is particularly configured to acquire a first adjustment command input by the user, wherein the first adjustment command instructs the vehicle's rearview mirror to be adjusted, and to control the rearview mirror to be adjusted to a second target position based on the first adjustment command and human eye position data.
[0038] In possible implementations, the control unit is particularly configured to acquire a second adjustment command input by the user within a predetermined time after acquiring a first adjustment command, wherein the second adjustment command commands the vehicle's rearview mirror to adjust in the target direction, and to control the rearview mirror based on the second adjustment command so that it adjusts from a second target position to a third target position in the target direction.
[0039] In possible implementations, the first adjustment command and / or the second adjustment command may be commands entered by the user via voice data or by operating physical buttons.
[0040] In possible implementations, the processing unit is further configured to determine the rearview mirror to be adjusted based on human eye position data. According to a third aspect, one embodiment of the present application provides a control device including a processor and memory. The memory is configured to store a computer program, and the processor is configured to call and execute the computer program stored in the memory in order to perform the method according to the first aspect and possible implementations of the first aspect.
[0041] According to a fourth aspect, one embodiment of the present application provides a chip including a processor configured to call a computer program from memory and execute the computer program, such that a device on which the chip is installed performs the method according to the first aspect and possible implementations of the first aspect.
[0042] According to a fifth aspect, one embodiment of the present application provides a computer-readable storage medium configured to store a computer program. The computer program enables a computer to perform the methods according to the first aspect and possible implementations thereof.
[0043] According to a sixth aspect, one embodiment of the present application provides a computer program product including computer program instructions. The computer program instructions enable a computer to perform the methods according to the first aspect and possible implementations thereof.
[0044] According to a seventh aspect, one embodiment of the present application provides a computer program that enables a computer to perform the methods according to the first aspect and possible implementations thereof.
[0045] According to the eighth aspect, one embodiment of the present application provides a device including a logic circuit and an input / output interface. The input / output interface is configured to receive signals from a communication device other than the device and transmit those signals to the logic circuit, or to transmit signals from the logic circuit to a communication device other than the device. The logic circuit is configured to execute code instructions to perform the method according to the first aspect and possible implementations of the first aspect.
[0046] According to the ninth aspect, one embodiment of the present application provides a vehicle including a control device in the second aspect or a possible implementation of the second aspect.
[0047] For the beneficial effects of the control devices provided in the possible implementations of the second and ninth embodiments, please refer to the beneficial effects achieved by the first embodiment and the possible implementations of the first embodiment. Details will not be repeated here. [Brief explanation of the drawing]
[0048] [Figure 1] This is a diagram showing the structure of a vehicle according to one embodiment of this application. [Figure 2] This is a schematic flowchart of a rearview mirror control method according to one embodiment of this application. [Figure 3a] This is a diagram of a rearview mirror control method according to one embodiment of the present application. [Figure 3b] This is a diagram of a rearview mirror control method according to one embodiment of the present application. [Figure 3c] This is a diagram of a rearview mirror control method according to one embodiment of the present application. [Figure 4] This is a schematic flowchart of another rearview mirror control method according to one embodiment of this application. [Figure 5a] This is a diagram of a rearview mirror control method according to one embodiment of the present application. [Figure 5b] This is a diagram of a rearview mirror control method according to one embodiment of the present application. [Figure 5c] This is a diagram of a rearview mirror control method according to one embodiment of the present application. [Figure 6] This is a block diagram of a vehicle control device according to one embodiment of the present application. [Figure 7] This is a block diagram of another vehicle control device according to one embodiment of the present application. [Modes for carrying out the invention]
[0049] The following describes the technical solutions in the embodiments of this application with reference to the accompanying drawings.
[0050] The technical solutions in embodiments of this application may be implemented by a mobile device having any appearance, or by a device deployed in a mobile device, for example, an intelligent vehicle or an intelligent robot. The intelligent vehicle may be an autonomous vehicle that performs all functions as automatic control, or an auxiliary vehicle that performs some functions as automatic control to provide driving assistance, or it may be a general vehicle on which an intelligent terminal is deployed. The intelligent vehicle will be referred to as "vehicle" below.
[0051] In addition, embodiments of the present application may be further implemented by a device connected to a mobile device. The device may be implemented as a terminal device, and may be deployed on a terminal device such as a smartphone, tablet computer, notebook computer, or desktop computer, but is not limited to these. Alternatively, the electronic device may be a server. The server may be an independent physical server, a server cluster or distributed system including multiple physical servers, or a cloud server that provides cloud computing services.
[0052] In response to the problem of the prior art where insufficient convenience in adjusting the rearview mirror leads to inadequate driving experience and affects driving safety, the embodiments of this application provide a rearview mirror control solution. When the user intends to control the vehicle to enter a driving state or to switch driving states, the rearview mirror is intelligently adjusted, avoiding manual adjustment of the rearview mirror and improving the user's driving experience and driving safety.
[0053] Furthermore, when it is determined that the user intends to enter or switch to driving mode, the rearview mirrors are adjusted to a position (or angle) suitable for the driver, based on the position of the human eye. This improves the convenience and safety of using the vehicle.
[0054] Figure 1 is a diagram of the structure of a vehicle according to one embodiment of the present application. Referring to Figure 1, a cockpit controller 110 is deployed in the vehicle 100. The cockpit controller 110 is connected to a vehicle control unit 120, an image processor 130, a rearview mirror control device 140, and a man-machine interaction device 150.
[0055] The vehicle control unit 120 is configured to acquire the vehicle's gear information. The gear information may indicate the vehicle's current gear. The gears set on the vehicle include, for example, at least one of the following: parking (P) gear, reverse (R) gear, neutral (N) gear, and drive (D) gear. In some vehicles, a low (L) gear is also set. Furthermore, the vehicle control unit 120 may transmit the gear information to the cockpit controller 110, or the vehicle control unit 120 may determine the vehicle's driving state, for example, forward or reverse driving, based on the gear information and transmit the vehicle's driving state to the cockpit controller 110.
[0056] In some embodiments, the vehicle control unit 120 may acquire vehicle speed information and transmit that vehicle speed information to the cockpit controller 110.
[0057] The cockpit controller 110 may obtain the vehicle's driving status from the vehicle control unit 120, or the cockpit controller 110 may obtain the vehicle's gear information from the vehicle control unit 120 and determine the vehicle's current driving status based on the obtained gear information.
[0058] In some embodiments, the cockpit controller 110 may further acquire vehicle speed information from the vehicle control unit 120.
[0059] The image processor 130 is connected to the image acquisition device 131, acquires images collected by the image acquisition device 131, performs image processing based on the acquired images, and may perform image recognition based on a user image to acquire human eye position data, for example. The image acquisition device 131 may be implemented as a camera module. The image processor 130 may transmit the data obtained by image recognition to the cockpit controller 110, or the cockpit controller 110 may acquire the data obtained by image recognition from the image processor 130.
[0060] The deployment location of the image acquisition device 131 is not limited to the embodiments of this application, and the number of image acquisition devices 131 deployed in the vehicle is not limited. For example, the image acquisition device 131 may be deployed on mechanical components in the vehicle cockpit and / or integrated into a screen in the vehicle. For example, the image acquisition device 131 may be deployed near the A-pillar and / or B-pillar, or at the front upper part of the vehicle cockpit. In another example, the image acquisition device 131 may be deployed on a control screen in the vehicle (at least one of the top, left, and right parts of the control screen, etc.).
[0061] The cockpit controller 110 may send a control command to the rearview mirror control device 140, which adjusts the position (or angle) of the rearview mirror 141 based on the control command. Optionally, the rearview mirror control device 140 may function as a motor controller.
[0062] The rearview mirror 141 may include, but is not limited to, at least one of the following: the left rearview mirror (abbreviated as the left rearview mirror), the right rearview mirror (abbreviated as the right rearview mirror), or an internal rearview mirror. Adjusting the position (or angle) of the rearview mirror 141 may include changing the position (or angle) of any rearview mirror by rotating it in any direction, for example, by performing longitudinal and / or lateral adjustments relative to the rearview mirror, where the lateral and longitudinal adjustments are relative to the upward, downward, left, and right directions as perceived by the driver when driving the vehicle.
[0063] The human-machine interaction device 150 may interact with the user based on the control of the cockpit controller 110. For example, the human-machine interaction device 150 may include at least one of a speaker, a microphone, and a display. The human-machine interaction device 150 may display prompt information based on the control of the cockpit controller 110.
[0064] It should be noted that the apparatus shown in Figure 1 is merely an example and not a limiting description, and that all or part of the apparatus may be integrated into a single physical entity or may be independent of each other.
[0065] The rearview mirror control method provided in the embodiments of this application will be described in detail below with reference to the attached drawings.
[0066] For ease of understanding and explanation, the method provided in the embodiments of this application will be described below by using a vehicle control device as the implement. The control device may be, for example, the cockpit controller 110 in Figure 1. It is clear that this is not limited to the present application. For example, the embodiments of this application may be carried out by a vehicle control unit or any component having processing capabilities within the vehicle.
[0067] The vehicle control device may be implemented as a component within the vehicle, for example, a chip, a chip system, or another functional module capable of calling and executing a program. The vehicle control device may be used as an implement of the method provided in the embodiments of the application, insofar as it can execute the method provided in the embodiments of the application by executing a program that records the code of the method provided in the embodiments of the application.
[0068] Figure 2 is a schematic flowchart of a rearview mirror control method 200 according to one embodiment of the present application. As shown in Figure 2, the method 200 may include the following S210 and S220.
[0069] S210: Determine the user's control intent for the vehicle, which includes the intent to control the vehicle to enter a driving state or to control the vehicle to switch driving states.
[0070] S220: Based on control intent and human eye position data, the vehicle's rearview mirror is controlled to adjust to a first target position.
[0071] As mentioned above, the driving state includes both forward driving and reverse driving.
[0072] The intention to control a vehicle to enter a driving state may also be the intention to switch the vehicle from a parked state to a driving state. For example, the intention to control a vehicle to enter a driving state may be reflected by starting the vehicle or moving the vehicle, or by controlling the vehicle to switch from a parked state (for example, the vehicle is in parking gear or neutral gear) to a driving state.
[0073] It should be understood that when a vehicle is moving forward and in reverse, the position (or angle) of the rearview mirrors needs to differ to provide the user with a preferred view of the area behind the vehicle. Therefore, the control device may adjust the rearview mirrors based on the control intent. For example, the control device may control the vehicle's rearview mirrors to adjust to a position corresponding to the driving state when the vehicle enters or switches between driving states.
[0074] For the sake of clarity, the position (or angle) of the rearview mirror that provides a favorable field of view to the user will be referred to below as the position (or angle) corresponding to the rearview mirror. The position (or angle) corresponding to the driving state is the position (or angle) of the rearview mirror that provides a favorable field of view to the user in the driving state. Similarly, the position (or angle) corresponding to the control intent is the position (or angle) of the rearview mirror that provides a favorable field of view to the user in the control intent.
[0075] For example, assuming the same eye position, different control intentions correspond to different positions of the rearview mirrors. In other words, if the control intention is to enter a driving state, the control device may adjust the vehicle's rearview mirrors to a first position based on the eye position data, or if the control intention is to switch driving states, the control device may adjust the vehicle's rearview mirrors to a second position based on the eye position data. Generally, assuming the same eye position, the first and second positions are different first target positions.
[0076] For example, with the same control intent, different driving conditions may correspond to different positions (or angles) of the rearview mirrors. For instance, if the control intent is to switch driving conditions and the vehicle's gear is shifted from drive gear to reverse gear, the control device may control the vehicle's rearview mirrors to adjust to a third position based on human eye position data. As another example, if the control intent is to switch driving conditions and the vehicle's gear is shifted from reverse gear to drive gear, the control device may control the vehicle's rearview mirrors to adjust to a fourth position based on human eye position data. Both the third and fourth positions may be specific implementations of the second position.
[0077] For example, different driving conditions may correspond to different positions (or angles) of the rearview mirrors. For instance, after the user has started the vehicle, i.e., when the vehicle is moving forward, the rearview mirrors need to be adjusted to a position suitable for observing vehicles behind to provide a basis for overtaking and lane changes. As another example, when the user shifts from drive gear to reverse gear, the rearview mirrors need to be adjusted to a position that facilitates observation of road conditions and obstacles on the road surface to ensure safety. Different control intentions may correspond to different positions (or angles) of the rearview mirrors. In other words, the same driving condition with different control intentions may correspond to different positions (or angles) of the rearview mirrors. For example, the position of the rearview mirrors that provides a favorable field of view when the vehicle is moving forward may be different from the position of the rearview mirrors that provides a favorable field of view when the vehicle is switching from reverse to forward.
[0078] Based on this, in some embodiments, the control device may, in response to a braking operation (e.g., pressing the brake) input by the user while the vehicle is in parking gear, determine that the user's intention to control the vehicle is to enter a driving state. Referring to Figure 3a, the cockpit controller obtains vehicle gear information from the vehicle control unit, determines that the vehicle is in parking gear, and detects that the user has performed a braking operation. For example, the vehicle control unit detects that the brake has been triggered and sends a braking command to the cockpit controller. In another example, the cockpit controller, based on a user image, determines that the user is seated and pressing the brake, and as a result, the cockpit controller obtains human eye position data, refers to the human eye position data to determine a rearview mirror adjustment command, which commands the rearview mirror control device to control the rearview mirror to adjust to a first position. Furthermore, the rearview mirror control device adjusts the rearview mirror based on the rearview mirror adjustment command.
[0079] The rearview mirror adjustment function may be activated initially before the rearview mirror is controlled to adjust to a first target position, at the discretion of the vehicle control unit. For example, the vehicle control unit may enable the rearview mirror adjustment function in response to user input, or the vehicle control unit may enable the rearview mirror adjustment function in response to a trigger event, for example, after determining that the user has entered the cockpit based on images collected by an image acquisition device, or the vehicle control unit may enable the rearview mirror adjustment function by default. Once the rearview mirror adjustment function is activated by the vehicle control unit, the cockpit controller can control the rearview mirror to achieve automatic adjustment.
[0080] If the human eye positioning function is optionally activated, the control device may control the vehicle's rearview mirrors to adjust to a first target position based on the human eye position data. For example, the cockpit controller may enable the human eye positioning function when the rearview mirror adjustment function is activated.
[0081] Furthermore, the control unit may, in response to other user actions, further determine that the user's intention to control the vehicle is to enter a driving state. For example, the control unit may, in response to the user triggering the vehicle's start button, determine that the user's intention to control the vehicle is to enter a driving state. In another example, the control unit may, in response to the user operating the vehicle's gear, determine that the user's intention to control the vehicle is to enter a driving state when the vehicle's gear is switched from parking gear (or neutral gear) to drive gear (or reverse gear).
[0082] The intention to control the vehicle to switch driving states may include switching the vehicle from reverse gear to drive gear, or from drive gear to reverse gear, and reflects the intention to switch driving states. Based on this, in some embodiments, the control device may determine, in response to a gear shifting operation input by the user, that the user's intention to control the vehicle is to switch driving states. The gear shifting operation is used to switch the vehicle from a first gear to a second gear, where the second gear is either reverse gear or drive gear, and the first gear is different from the second gear. For example, the second gear is reverse gear and the first gear is drive gear. In another example, the second gear is drive gear and the first gear is reverse gear.
[0083] Referring to Figure 3b, the vehicle control unit may switch the vehicle from another driving state (e.g., forward driving) to a reverse driving state in response to a gear shift operation by the user. The cockpit controller obtains the vehicle's gear information from the vehicle control unit and, upon determining that the vehicle has switched from another driving state (e.g., forward driving) to a reverse driving state, obtains human eye position data and, referring to the human eye position data, determines a rearview mirror adjustment command. The rearview mirror adjustment command instructs the rearview mirror control device to adjust the rearview mirror to a second position. Furthermore, the rearview mirror control device adjusts the rearview mirror based on the rearview mirror adjustment command.
[0084] Referring to Figure 3c, the cockpit controller obtains vehicle gear information from the vehicle control unit and, upon determining that the vehicle has switched from forward to reverse, controls the rearview mirror to adjust to the third position by referring to the human eye position data. For details, please refer to the implementation configuration in Figure 3b. Furthermore, the vehicle control unit may switch the vehicle from reverse to forward in response to a gear shift operation by the user. The cockpit controller obtains vehicle gear information from the vehicle control unit and, upon determining that the vehicle has switched from reverse to forward, obtains human eye position data and, referring to the human eye position data, determines a rearview mirror adjustment command. The rearview mirror adjustment command instructs the rearview mirror control device to adjust the rearview mirror to the fourth position. Furthermore, the rearview mirror control device adjusts the rearview mirror based on the rearview mirror adjustment command. The vehicle may switch between forward and reverse driving states once or more times, and the rearview mirrors may be controlled to adjust to the corresponding position when at least one of the driving states is switched.
[0085] In the embodiments described above, the control device may control the rearview mirror to adjust to a first target position based on the control intent. However, as described above, in order to further provide the driver with a preferred field of view after the rearview mirror has been adjusted, the control device may further adjust the rearview mirror by referring to human eye position data. The human eye position data may be the position of the driver's eyes in three-dimensional space. The three-dimensional space may be a three-dimensional space in a geodetic coordinate system or a three-dimensional space in a cockpit coordinate system. This is not limited to the present application. For example, different drivers have different heights and different eye positions. As another example, changes in the driver's seating posture while driving cause changes in eye position. Thus, the rearview mirror is adjusted based on the control intent and human eye position data. In other words, the rearview mirror is adjusted to a first target position, and as a result, the rearview mirror may be adjusted to a position that coincides with the driver's eye position, thereby providing the driver with a preferred field of view.
[0086] The first target position may be a position that is a deviation from the position of the rearview mirror determined based on the control intent.
[0087] For example, the control device may acquire the user's eye position data in advance. The eye position data may be collected and stored in advance. For example, an image processor (e.g., image processor 130 in Figure 1) performs image recognition on a user image collected by an image acquisition device (e.g., image acquisition device 131 in Figure 1) to acquire the eye position data, stores the eye position data, and as a result, the control device acquires the corresponding eye position data in the rearview mirror adjustment process. Alternatively, the eye position data may be determined in real time by the control device. For example, the control device acquires a user image collected by an image acquisition device (e.g., image acquisition device 131 in Figure 1), performs image recognition on the user image to acquire the eye position data. The image processor may perform image processing based on instructions from the control device. Therefore, whether the eye position data is acquired directly by the control device by recognizing the user image or transmitted to the control device by the image processor by recognizing the user image, the eye position data may be understood as eye position data acquired by the control device.
[0088] The user image may be located in the cockpit and may be an image collected by any image acquisition device deployed within the vehicle, and the image will at least show the vehicle's user (e.g., the driver).
[0089] In this embodiment of the present application, when the user intends to control the vehicle to enter a driving state or to switch driving states, the rearview mirrors are automatically adjusted, avoiding manual adjustment of the rearview mirrors and improving the user's driving experience and driving safety, especially when driving states are frequently entered or switched. Furthermore, the rearview mirrors are adjusted to a first target position relative to the position of the human eye, thereby allowing the position (or angle) of the rearview mirrors to match the user, thereby providing the user with a preferred field of view.
[0090] The following describes examples of user image collection opportunities for two control intentions.
[0091] Example 1: If the control intent is to control the vehicle so that it enters a driving state, the control device may control the image acquisition device so that it starts collecting user images when the user gets into the vehicle. Furthermore, the control device determines human eye position data based on the user images.
[0092] Optionally, the control device may monitor the vehicle's cockpit via an image acquisition device and begin collecting user images when a user enters the vehicle's cockpit; or the control device may monitor via a door detection device to determine when a user opens a vehicle door and enters the vehicle's cockpit and begin collecting user images; or the control device may determine via a seat sensor (e.g., a gravity sensor mounted on the seat) that a user is in the vehicle's cockpit and begin collecting user images.
[0093] In Example 1 described above, the control device may continuously collect user images until the user exits the vehicle's cockpit, may stop after the vehicle is in motion and rearview mirror adjustment is complete, or may stop after the user completes one driving cycle. A driving cycle refers to the process from starting the vehicle to stopping it, or from turning on the vehicle's power to turning it off.
[0094] Example 2: The control intent is to control the vehicle to switch driving states. As mentioned above, switching the driving state of the vehicle may mean that the vehicle switches from a first gear to a second gear. In this case, the control device may control the image acquisition device to collect user images when the vehicle is running in the first gear or the second gear. That is, the control device may control the image acquisition device to collect user images before the vehicle switches from the first gear to the second gear (for example, at the last moment of running in the first gear), or may control the image acquisition device to collect user images during the process of the vehicle switching from the first gear to the second gear, or may control the image acquisition device to collect user images after the vehicle has switched to the second gear (for example, at the initial moment of switching to the second gear). Furthermore, the control device determines human eye position data based on the user images.
[0095] In some embodiments, the user image acquisition process in Example 2 described above may be part of the image acquisition process in Example 1 described above. For example, the control device continuously acquires user images after the user enters the vehicle's cockpit and updates human eye position data determined based on the user images in real time.
[0096] Figure 4 is a schematic flowchart of another rearview mirror control method 300 according to one embodiment of the present application. Method 300 describes an example of performing rearview mirror adjustment using the user image acquisition opportunity in the control intent of Example 1 described above as an example. Method 300 may include some or all of the following steps.
[0097] S301: After the user gets into the vehicle, the control unit determines whether the rearview mirror adjustment function is activated. If the rearview mirror adjustment function is activated, S303 is executed; otherwise, as shown in S304, if the rearview mirror adjustment function is not activated, the rearview mirror adjustment is not performed.
[0098] S302: The control unit collects images from within the cockpit via an image acquisition device in order to acquire user images.
[0099] S303: The control device detects the user's head posture. For example, the control device recognizes a user image to obtain the user's head position and posture information, and based on the user's head position and posture information, determines whether the duration for which the user's face is facing a first direction reaches a preset duration. The first direction may be the user's front, left front, right front, left, right, etc. For example, not limited to, when the vehicle is started (or enters a driving state), the first direction may be the user's right front. When the vehicle switches from a forward driving state to a reverse driving state, the first direction may be the user's left, front, left front, right, right front, etc.
[0100] When the duration for which the user's face is facing a first direction reaches a preset duration, accurate human eye position data can be obtained based on the user image. Therefore, when the duration for which the user's face is facing a first direction reaches a preset duration, the control device can determine and store the human eye position data based on the user image, or the control device can perform S305 below. If the duration for which the user's face is facing a first direction does not reach a preset duration, rearview mirror adjustment is not performed, as shown in S306, i.e., human eye position data cannot be obtained. Reaching a preset duration may mean that the duration is greater than or equal to the preset duration, and not reaching a preset duration may mean that the duration is less than the preset duration. The preset duration may be any value, for example, 2 seconds, 2.5 seconds, or 5 seconds.
[0101] Furthermore, if the control device is unable to obtain human eye position data, the control device may display prompt information, as shown in S307. The prompt information indicates that the duration for which the user has looked in a first direction has reached a preset duration. For example, the control device may play the prompt information through a speaker, or the control device may display the prompt information through a display. The prompt information may be, for example, "Look straight ahead and hold for 2 seconds."
[0102] S305: The control device determines whether the seat position has changed during the first period. The first period may be the duration of user image collection, or the duration of user image collection may include the first period. For example, the first period may be the period during which the user looks in a first direction during the process of collecting user images, and the duration of the first period may be greater than or equal to a preset duration. If the seat changes, accurate human eye position data cannot be determined based on the user image. In other words, valid human eye position data cannot be obtained. Therefore, in order to obtain accurate human eye position data, the control device may execute S308 if the seat in which the user sat during the first period has not been adjusted, and execute S309 if the seat in which the user sat during the first period has been adjusted.
[0103] S308: The control device determines human eye position data based on the user image. In some embodiments, the control device may store the human eye position data as valid human eye position data.
[0104] S309: The control device does not need to recognize a user image to acquire human eye position data, or the control device does not store human eye position data. Furthermore, the control device may display prompt information via a human-machine interaction device, which indicates that the adjustment of the seat in which the user is sitting has stopped, or that the duration for which the user has faced a first direction after seat adjustment has reached a preset duration. For example, the control device may play the prompt information via a speaker, or the control device may display the prompt information via a display. The prompt information may be, for example, "Look forward after seat adjustment is complete" or "Do not adjust the seat, look forward and hold for 2 seconds."
[0105] The control device may continuously detect the seat position, and when the change in seat position stops, it may recognize a user image to obtain valid human eye position data and store the human eye position data.
[0106] S310: When the vehicle is in parking gear, in response to a braking operation input by the user, the control unit performs recognition based on the user image collected in S302 to obtain human eye position data, or retrieves stored human eye position data, and determines a first target position of the rearview mirror based on the human eye position data.
[0107] S311: The control device determines the discrepancy between the first target position and the current position of the rearview mirror, and the discrepancy may be an angular discrepancy.
[0108] If the deviation between the first target position and the current position of the rearview mirror is greater than or equal to the deviation threshold, the control device controls the rearview mirror to adjust to the first target position, as shown in S312. If the deviation between the first target position and the current position of the rearview mirror is less than the deviation threshold, the rearview mirror is not adjusted, as shown in S313. It should be understood that if the deviation between the first target position and the current position of the rearview mirror is large, the rearview mirror is adjusted, thereby avoiding the high overhead of the control device due to frequent adjustment of the rearview mirror.
[0109] Furthermore, if the control intent is to switch the driving state, the process by which the control device determines the position data of the human eye is similar to at least some of the processes in S301 to S309 in Figure 4, with only the opportunity to collect user images differing. For the sake of brevity, the details will not be explained again.
[0110] In some scenarios, as shown in Figure 3c, multiple gear changes may be performed in a short period of time. For example, when a vehicle is performing reverse parking, multiple gear changes may be made to adjust the vehicle's direction, or the driver may make multiple gear changes quickly due to incorrect gear control. In this case, adjustment of the rearview mirrors is unnecessary. For example, when a vehicle is performing reverse parking, even if the vehicle switches from reverse driving to forward driving, the rearview mirrors may remain in the position corresponding to the reverse driving state and do not need to be changed frequently. Therefore, in this embodiment, the control device may determine whether the vehicle speed is above a speed threshold, and if the vehicle speed is above a speed threshold, it may control the vehicle's rearview mirrors to adjust to a first target position based on the control intent and human eye position data.
[0111] To further improve the convenience of vehicle use and driving safety, in this embodiment of the present application, the control device may adjust the rearview mirrors in the vehicle use process in response to a command input by the user used to adjust the rearview mirrors, or it may adjust the rearview mirrors in a process of automatically adjusting the rearview mirrors under the aforementioned trigger conditions (for example, to enter or switch driving states), and adjust the rearview mirrors to a second target position.
[0112] For example, the control device may acquire a first adjustment command entered by the user and control the rearview mirror to adjust to a second target position based on the first adjustment command entered by the user and human eye position data. The first adjustment command may be a command entered by the user via voice data, i.e., a voice control command, or the first adjustment command may be a command entered by the user by operating a physical button. This is not limited to the present application.
[0113] Refer to Figure 5a. The cockpit controller receives voice control commands via the microphone. Voice control commands may be generated by the microphone by collecting voice data entered by the user, for example, "Adjust the rearview mirror" or "Adjust the left and right rearview mirrors," and then performing a sound conversion. The cockpit controller may determine which rearview mirror to adjust based on the voice control command, or the cockpit controller may recognize which rearview mirror to adjust based on the user's head posture information. Furthermore, the cockpit controller may acquire human eye position data, refer to this human eye position data to determine a rearview mirror adjustment command, which is used to adjust the rearview mirror to a second target position, and the rearview mirror control device adjusts the rearview mirror based on the rearview mirror adjustment command. For example, the cockpit controller may display prompt information after the rearview mirror has been adjusted to the second target position. For example, the cockpit controller acquires the rearview mirror adjustment result from the rearview mirror control device and determines that the rearview mirror has been adjusted to the second target position. The prompt information indicates that the rearview mirror adjustment is complete. For example, prompt information can be played through the speaker or displayed on the screen.
[0114] For example, the control device determining the rearview mirror to be adjusted based on the user's head posture information may include the control device determining the direction the user's face is facing or the direction of the user's gaze based on the user's head posture information, and determining the rearview mirror to be adjusted based on the direction the user's face is facing or the direction of the user's gaze. For example, if the user is looking at the left rearview mirror, the rearview mirror to be adjusted is the left rearview mirror, or if the user is looking at the right rearview mirror, the rearview mirror to be adjusted is the right rearview mirror.
[0115] Please refer to Figure 5b. The user looks at the rearview mirror to be adjusted and taps the angle adjustment button. The cockpit controller determines the rearview mirror to be adjusted in response to the user's input. Furthermore, the cockpit controller acquires human eye position data and, referring to this data, determines a rearview mirror adjustment command. This command is used to adjust the rearview mirror to a second target position, and the rearview mirror control device adjusts the rearview mirror based on the command. Similar to Figure 5b, the cockpit controller may display prompt information after the rearview mirror has been adjusted to the second target position to indicate that the rearview mirror adjustment is complete. For brevity, further details will not be explained again.
[0116] Based on the embodiments described above in 5a and 5b, the rearview mirror is further fine-tuned so that the adjustment of the rearview mirror meets the user's requirements. In this embodiment of the present application, the control device receives a second adjustment command entered by the user within a preset time after receiving a first adjustment command, the second adjustment command instructs the vehicle's rearview mirror to adjust in a target direction, which may be any direction in three-dimensional space. Furthermore, based on the second adjustment command, the control device controls the rearview mirror so that it adjusts from a second target position to a third target position in the target direction. The deviation between the third target position and the second target position may be a preset deviation.
[0117] Refer to Figure 5c. An example is used in which both the first and second adjustment commands are commands entered by the user via voice data. In other words, the first adjustment command is the first voice control command, and the second adjustment command is the second voice control command, and the interval between the voice data collection time for the first voice control command and the voice data collection time for the second voice control command may be less than or equal to a preset time interval. The process of generating the first rearview mirror adjustment command based on the first voice control command to control the rearview mirror to adjust to a second target position is similar to the example shown in Figure 5a and will not be repeated in detail here. The cockpit controller collects voice data entered by the user via the microphone, for example, "move up / down / left / right / forward / backward", and the microphone converts the voice data into a second voice control command by sound conversion. The cockpit controller determines a second rearview mirror adjustment command based on a second voice control command, which instructs the rearview mirror control device to control the rearview mirror upward / downward / leftward / rightward / forward / rearward so that it is adjusted from a second target position to a third target position, and the rearview mirror control device adjusts the rearview mirror based on the second rearview mirror adjustment command. As in Figures 5a and 5b, the cockpit controller may display prompt information indicating that the rearview mirror adjustment is complete after the rearview mirror has been adjusted to the third target position. For brevity, further details will not be explained again.
[0118] Figure 6 is a block diagram of a vehicle control device according to one embodiment of the present application. As shown in Figure 6, the control device 400 includes some or all of a processing unit 410, a control unit 420, an acquisition unit 430, a collection unit 440, and a man-machine interaction unit 450.
[0119] The processing unit 410 may be configured to determine the user's control intent for the vehicle, which includes the intent to control the vehicle to enter a driving state or to control the vehicle to switch driving states. The control unit 420 may be configured to control the vehicle's rearview mirrors to adjust to a first target position based on the control intent and human eye position data.
[0120] In possible implementations, the processing unit 410 is specifically configured to determine, in response to a braking operation input by the user while the vehicle is in parking gear, that the user's intention to control the vehicle is to enter a driving state.
[0121] In possible implementations, the processing unit 410 is specifically configured to determine, in response to a gear shifting operation input by the user, that the user's intention to control the vehicle is to switch the driving state, the gear shifting operation being used to switch the vehicle from a first gear to a second gear, the second gear being either a reverse gear or a drive gear, and the first gear being different from the second gear.
[0122] In possible implementations, the control unit is specifically configured to either adjust the vehicle's rearview mirrors to a first position based on human eye position data when the control intention is to enter a driving state, or adjust the vehicle's rearview mirrors to a second position based on human eye position data when the control intention is to switch driving states.
[0123] In possible implementations, the acquisition unit 430 may be configured to acquire the user's eye position data, which is determined based on the collected user image.
[0124] In possible implementations, the control intent is the intent to control the vehicle to enter a driving state, and the collection unit 440 may be configured to collect user images in response to the user getting into the vehicle.
[0125] In possible implementations, the control intent is to control the vehicle to switch driving states, and the acquisition unit 440 may be configured to acquire user images when the vehicle is driving in a first gear or a second gear, the first gear being the gear the vehicle was in before the driving state was switched.
[0126] In possible implementations, the processing unit 410 is further configured to: recognize a user image in order to obtain the user's head posture information; determine, based on the head posture information, whether the duration for which the user's face is facing a first direction reaches a preset duration; and, if the duration for which the user's face is facing a first direction reaches a preset duration, determine human eye position data based on the user image.
[0127] In possible implementations, the control intent is to control the vehicle to enter a driving state, and the first direction is the user's forward direction.
[0128] In a possible implementation, the processing unit 410 is further configured to determine human eye position data based on a user image if the seat in which the user is sitting is not adjusted during a first period, where the first period is the duration of user image collection.
[0129] In possible implementations, the human-machine interaction unit 450 may be configured to display prompt information if human eye position data is not obtained, the prompt information indicating that the duration for which the user's face is facing a first direction has reached a preset duration, and / or This indicates that adjustments to seats occupied by a user will be stopped.
[0130] In possible implementations, the control intent is to control the vehicle to switch from a reverse driving state to a forward driving state, and the control unit 420 is specifically configured to determine whether the vehicle speed of the vehicle in the forward driving state is equal to or greater than a speed threshold, and if the vehicle speed is equal to or greater than the speed threshold, to control the vehicle's rearview mirror to adjust to a first target position based on the control intent and human eye position data.
[0131] In possible implementations, the control unit 420 is specifically configured to determine the deviation between a first target position and the current position of the rearview mirror based on the control intent and human eye position data, and to control the vehicle's rearview mirror to adjust to the first target position if the deviation is greater than or equal to a deviation threshold.
[0132] In possible implementations, the control unit 420 is particularly configured to acquire a first adjustment command input by the user, wherein the first adjustment command commands the vehicle's rearview mirror to be adjusted, and to control the rearview mirror to be adjusted to a second target position based on the first adjustment command and human eye position data.
[0133] In possible implementations, the control unit 420 is particularly configured to acquire a second adjustment command input by the user within a predetermined time after acquiring a first adjustment command, wherein the second adjustment command commands the vehicle's rearview mirror to adjust in the target direction, and to control the rearview mirror based on the second adjustment command so that it adjusts from a second target position to a third target position in the target direction.
[0134] In possible implementations, the first adjustment command and / or the second adjustment command include commands entered by the user via voice control commands or by operating physical buttons.
[0135] In possible implementations, the processing unit 410 is further configured to determine the rearview mirror to be adjusted based on human eye position data.
[0136] The specific process by which each module performs the corresponding steps described above is described in detail in the embodiments of the method described above. For brevity, the details will not be described again here.
[0137] The division of a device into units / modules is simply a logical functional division. In actual implementations, all or part of the units / modules may be integrated into a single physical entity, or they may be physically separated.
[0138] Figure 7 is a block diagram of another vehicle control device 500 according to one embodiment of the present application. The device 500 may include a processor 510 and a memory 520. The processor 510 and the memory 520 communicate with each other via an internal connection path. The memory 520 is configured to store instructions. The processor 510 is configured to execute instructions stored in the memory 520.
[0139] Optionally, memory 520 may include read-only memory and random-access memory, and may provide instructions and data to processor 510. Memory 520 may be a separate device or may be integrated into processor 510.
[0140] In some embodiments, the device 500 may further include an input interface 530. The processor 510 may control the input interface 530 to communicate with another device or chip, and in particular may acquire information or data transmitted by the other device or chip.
[0141] In some embodiments, the device 500 may further include an output interface 540. The processor 510 may control the output interface 540 to communicate with another device or chip, and in particular may output information or data to another device or chip.
[0142] In some embodiments, the apparatus 500 may implement the corresponding steps of the method in the embodiments of this application. For brevity, further details are not described here.
[0143] It should be understood that the processor in this embodiment of the application may be an integrated circuit chip and has signal processing capabilities. In the implementation form process, the steps in the method embodiment described above may be carried out by using hardware integrated logic circuits in the processor or by using instructions in the form of software. The processor may be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or another programmable logic device, discrete gate or transistor logic device, or discrete hardware component. The methods, steps, and logic block diagrams disclosed in the embodiments of this application may be implemented or executed. The general-purpose processor may be a microprocessor, or the processor may be any conventional processor, etc. The steps of the method disclosed with reference to the embodiments of this application may be carried out and completed directly by a hardware decoding processor, or by using a combination of hardware and software modules in the decoding processor. The software module may reside in a mature storage medium in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. The storage medium resides in memory, and the processor reads the information in memory and, together with the processor hardware, completes the steps in the aforementioned method.
[0144] It can be understood that the memory in this embodiment of the present application may be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (Erasable PROM, EPROM), electrically erasable programmable read-only memory (Electrically EPROM, EEPROM), or flash memory. Volatile memory may be random access memory (RAM) used as an external cache. Rather than being a restrictive description, many forms of RAM may be used as examples, such as static random access memory (Static RAM, SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (Synchronous DRAM, SDRAM), double data rate synchronous dynamic random access memory (Double Data Rate SDRAM, DDR SDRAM), enhanced synchronous dynamic random access memory (Enhanced SDRAM, ESDRAM), synchlink dynamic random access memory (Synchlink DRAM, SLDRAM), and direct Rambus random access memory (Direct Rambus RAM, DR RAM). Note that the memory of the systems and methods described herein includes, but is not limited to, these memories and any other suitable type of memory.
[0145] One embodiment of this application further provides a computer-readable storage medium configured to store a computer program. In some embodiments, the computer program enables a computer to perform a corresponding step of the method in the embodiment of this application. For brevity, further details are not described here.
[0146] One embodiment of this application further provides a computer program product including computer program instructions. In some embodiments, the computer program instructions enable a computer to perform a corresponding step of the method in the embodiments of this application. For brevity, further details are not described here.
[0147] One embodiment of this application further provides a computer program. In some embodiments, when the computer program is executed on a computer, the computer enables the computer to perform a corresponding step of the method in the embodiment of this application. For brevity, further details are not described here.
[0148] One embodiment of this application further provides a vehicle. In some embodiments, the intelligent vehicle includes a vehicle control device or control chip in the embodiments of this application.
[0149] Those skilled in the art will notice, in combination with the examples described in the embodiments disclosed herein, that the units and algorithmic steps may be implemented by electronic hardware, or by a combination of computer software and electronic hardware. Whether the function is performed by hardware or by software depends on the specific application and design constraints of the technical solution. Those skilled in the art may implement the functions described using various methods for specific applications, but such implementation should not be considered to exceed the scope of this application.
[0150] The foregoing description merely illustrates specific implementations of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications or substitutions readily conceivable by those skilled in the art within the technical scope disclosed herein shall also fall within the scope of protection of the present invention. Accordingly, the scope of protection of the present invention shall be subject to the scope of protection of the claims. [Explanation of Symbols]
[0151] 100 vehicles 110 Cockpit Controller 120 Vehicle control unit 130 Image Processors 131 Image acquisition device 140 Rearview mirror control device 141 Rearview mirror 150 Human-machine interaction devices 200 Rearview Mirror Control Method 300 Rearview Mirror Control Methods 400 Control Unit 410 Processing Units 420 Control Unit 430 units acquired 440 collection units 450 Man-Machine Interaction Unit 500 Vehicle control system 510 Processor 520 memory 530 Input Interface 540 Output Interface
Claims
1. A rearview mirror control method, A step of determining a user's control intent for a vehicle, wherein the control intent includes an intent to control the vehicle to enter a driving state, or an intent to control the vehicle to switch the driving state, The steps include controlling the vehicle's rearview mirror to adjust to a first target position based on the control intent and human eye position data, A rearview mirror control method, including...
2. The step of determining the user's control intent for the vehicle is, A step in which, in response to a braking operation input by the user while the vehicle is in parking gear, the user's control intention for the vehicle is determined to be the intention to enter the driving state, The method according to claim 1, including the method described in claim 1.
3. The step of determining the user's control intent for the vehicle is, The process includes the step of determining, in response to a gear shifting operation input by the user, that the user's control intention for the vehicle is the intention to switch the driving state, wherein the gear shifting operation is used to switch the vehicle from a first gear to a second gear, the second gear being a reverse gear or a drive gear, and the first gear being different from the second gear. The method according to claim 1.
4. The step of controlling the vehicle's rearview mirror to adjust to a first target position based on the control intent and human eye position data is: If the control intention is the intention to enter the driving state, the step of controlling the rearview mirror of the vehicle to adjust to a first position based on the position data of the human eye, If the control intent is the intent to switch the driving state, the step of controlling the rearview mirror of the vehicle to adjust to a second position based on the position data of the human eye, The method according to any one of claims 1 to 3, including the method described in any one of claims 1 to 3.
5. The process further includes the step of obtaining the position data of the user's human eye, wherein the position data of the human eye is determined based on the collected user image. The method according to any one of claims 1 to 4.
6. The aforementioned control intent is the intent to control the vehicle so that it enters the aforementioned driving state, In response to the user boarding the vehicle, the step of collecting the user image is performed. The method according to claim 5, further comprising:
7. The aforementioned control intent is the intent to control the vehicle to switch to the aforementioned driving state, The step further includes collecting the user image when the vehicle is running in the first gear or the second gear, wherein the first gear is the gear of the vehicle before the change in the running state, and the second gear is the gear of the vehicle after the change in the running state. The method according to claim 5.
8. The position data of the human eye is determined by the user image from which it was collected. To obtain the user's head posture information, the steps include: recognizing the user image; Based on the head posture information, the step of determining whether the duration for which the user's face is facing a first direction reaches a preset duration, If the duration for which the user's face is facing the first direction reaches the preset duration, the steps include determining the position data of the human eye based on the user image, The method according to any one of claims 5 to 7.
9. The method according to claim 8, wherein, if the control intention is the intention to enter the driving state, the first direction is the forward direction of the user.
10. If the seat in which the user is sitting has not been adjusted during the first period, the method further includes the step of determining the position data of the human eye based on the user image. The method according to any one of claims 5 to 9, wherein the first period is the duration of collection of the user image.
11. If the aforementioned human eye position data is not obtained, the further step includes displaying prompt information. The prompt information indicates that the duration for which the user's face is facing the first direction must reach the preset duration, and / or that the adjustment of the seat in which the user is sitting has been stopped. The method according to any one of claims 5 to 10.
12. The aforementioned control intent is to control the vehicle to switch from a reverse driving state to a forward driving state. The step of controlling the vehicle's rearview mirror to adjust to a first target position based on the control intent and human eye position data is: The steps include determining whether the vehicle speed in the forward driving state is equal to or greater than a speed threshold, If the vehicle speed of the vehicle is equal to or greater than the speed threshold, the vehicle's rearview mirror is controlled to adjust to a first target position based on the control intent and the human eye position data. The method according to any one of claims 1 to 11, including the method described in any one of claims 1 to 11.
13. The step of controlling the vehicle's rearview mirror to adjust to a first target position based on the control intent and human eye position data is: The steps include determining the deviation between the first target position and the current position of the rearview mirror based on the control intent and the human eye position data, If the deviation is greater than or equal to a deviation threshold, the vehicle's rearview mirror is controlled to adjust to the first target position. The method according to any one of claims 1 to 12, including the method described in any one of claims 1 to 12.
14. A step of obtaining a first adjustment command entered by the user, wherein the first adjustment command commands to adjust the rearview mirror of the vehicle; The steps include controlling the rearview mirror to adjust to a second target position based on the first adjustment command and the human eye position data, The method according to any one of claims 1 to 13, further comprising:
15. A step of obtaining a second adjustment command entered by the user within a predetermined time after obtaining the first adjustment command, wherein the second adjustment command commands the vehicle's rearview mirror to be adjusted in the direction of a target. A step of controlling the rearview mirror so that it is adjusted from the second target position to the third target position in the target direction based on the second adjustment command, The method according to claim 14, further comprising:
16. The method according to claim 14 or 15, wherein the first adjustment command and / or the second adjustment command include a voice control command from the user or a command entered by the user by operating a physical button.
17. A step of determining the rearview mirror to be adjusted based on the user's head posture information, The method according to any one of claims 1 to 16, further comprising:
18. A control device, A processing unit configured to determine a user's control intent for a vehicle, wherein the control intent includes an intent to control the vehicle to enter a driving state, or an intent to control the vehicle to switch the driving state, A control unit configured to control the rearview mirror of the vehicle to adjust to a first target position based on the control intent and human eye position data, A control device, including a control device.
19. The aforementioned processing unit is When the vehicle is in parking gear, in response to a braking operation input by the user, the user's control intention for the vehicle is determined to be the intention to enter the driving state. The apparatus according to claim 18, particularly configured.
20. The aforementioned processing unit is The system is particularly configured to determine, in response to a gear shifting operation input by the user, that the user's control intention for the vehicle is the intention to switch the driving state, wherein the gear shifting operation is used to switch the vehicle from a first gear to a second gear, the second gear being a reverse gear or a drive gear, and the first gear being different from the second gear. The apparatus according to claim 18.
21. The control unit is If the control intent is the intent to enter the driving state, the vehicle's rearview mirror is controlled to adjust to a first position based on the position data of the human eye, or If the control intent is the intent to switch the driving state, the vehicle's rearview mirror is controlled to adjust to a second position based on the position data of the human eye. The apparatus according to any one of claims 18 to 20, which is particularly configured to perform the following:
22. Acquisition unit, The system further includes an acquisition unit configured to acquire the position data of the user's human eye, wherein the position data of the human eye is determined based on the collected user image. The apparatus according to any one of claims 18 to 21.
23. The aforementioned control intent is the intent to control the vehicle so that it enters the aforementioned driving state, A collection unit configured to collect user images in response to the user boarding the vehicle, The apparatus according to claim 22, further comprising:
24. The aforementioned control intent is the intent to control the vehicle in order to switch the driving state, A collection unit configured to collect user images when the vehicle is running in the first gear or the second gear, The apparatus according to claim 20, further comprising:
25. The aforementioned processing unit is In order to obtain the user's head posture information, the user image is recognized, Based on the head posture information, it is determined whether the duration for which the user's face is facing a first direction reaches a preset duration, When the duration for which the user's face is facing the first direction reaches the preset duration, the position data of the human eye is determined based on the user image. The apparatus according to any one of claims 22 to 24, further configured to perform the following:
26. The apparatus according to claim 25, wherein the control intent is the intent to control the vehicle so that it enters the driving state, and the first direction is the forward direction of the user.
27. The aforementioned processing unit is If the seat occupied by the user is not adjusted during a first period, the system is further configured to determine the position data of the human eye based on the user image, where the first period is the duration of the user image collection. The apparatus according to any one of claims 22 to 26.
28. Further including a man-machine interaction unit, the man-machine interaction unit is If the aforementioned human eye position data is not acquired, the system is configured to display prompt information. The prompt information indicates that the duration for which the user's face is facing the first direction has reached the preset duration, and / or that the adjustment of the seat in which the user is sitting has stopped. The apparatus according to any one of claims 22 to 27.
29. The aforementioned control intent is to control the vehicle to switch from a reverse driving state to a forward driving state. The control unit is To determine whether the vehicle speed of the vehicle in the forward driving state is equal to or greater than a speed threshold, If the vehicle speed of the vehicle is equal to or greater than the speed threshold, the vehicle's rearview mirror is controlled to adjust to the first target position based on the control intent and the human eye position data. The apparatus according to any one of claims 18 to 28, which is particularly configured to perform the following:
30. The control unit is Based on the control intent and the human eye position data, the deviation between the first target position and the current position of the rearview mirror is determined. If the deviation is greater than or equal to the deviation threshold, the rearview mirror of the vehicle is controlled to be adjusted to the first target position. The apparatus according to any one of claims 18 to 29, which is particularly configured to perform the following:
31. The control unit is To obtain a first adjustment command entered by the user, wherein the first adjustment command commands to adjust the rearview mirror of the vehicle, and to obtain such command. Based on the first adjustment command and the human eye position data, the rearview mirror is controlled to be adjusted to a second target position. The apparatus according to any one of claims 18 to 30, which is particularly configured to perform the following:
32. The control unit is The process involves obtaining a second adjustment command entered by the user within a predetermined time after obtaining the first adjustment command, wherein the second adjustment command commands the vehicle's rearview mirror to adjust in the target direction. Based on the second adjustment command, the rearview mirror is controlled to adjust from the second target position to the third target position in the target direction, The apparatus according to claim 31, which is specifically configured to perform the following.
33. The apparatus according to claim 31 or 32, wherein any adjustment command includes a voice control command from the user or a command entered by the user by operating a physical button.
34. The aforementioned processing unit is The system is further configured to determine the rearview mirror to be adjusted based on the position data of the human eye. The apparatus according to any one of claims 18 to 33.
35. A control device comprising a processor and a memory, wherein the memory is configured to store a computer program, and the processor is configured to call and execute the computer program stored in the memory and to perform the method according to any one of claims 1 to 17.
36. A chip comprising a processor configured to call computer instructions from memory and execute the computer instructions so that a device on which the chip is installed performs the method according to any one of claims 1 to 17.
37. A computer-readable storage medium configured to store computer program instructions, wherein the computer program enables a computer to perform the method according to any one of claims 1 to 17.
38. A computer program product comprising computer program instructions, wherein the computer program instructions enable a computer to perform the method according to any one of claims 1 to 17.
39. A vehicle comprising a control device according to any one of claims 18 to 34.