Control method and device and vehicle
By detecting sensor data to distinguish between misoperation and normal operation, differentiated alarm methods are adopted to solve the problem of inflexible exit prompts for intelligent driving status, and improve driving safety and experience.
Patent Information
- Application Number
- CN202411150354.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-20
- Publication Date
- 2024-12-06
AI Technical Summary
The prompt method of existing intelligent driving technology when a vehicle exits the intelligent driving state is not flexible enough to meet the needs of different scenarios, which may affect the user's driving safety.
By detecting the data collected by the sensor, we can distinguish whether the driver has withdrawn from the intelligent driving state due to misoperation or normal operation. Differentiated alarm methods are adopted, including different levels of alarm levels and prompt information to improve the flexibility of prompt methods and users. Experience.
It improves the user's driving safety and experience, quickly pulls back the driver's attention, avoids unnecessary interference, and adapts to the needs of different scenarios.
Smart Images

Figure CN119078866A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of intelligent driving, and more specifically, to a control method, device and vehicle. Background Art
[0002] With the development of intelligent driving technology, vehicles can achieve a certain degree of autonomous driving in the intelligent driving state. Currently, when the vehicle exits the intelligent driving state, the user will be prompted that the vehicle has exited the intelligent driving state. This prompt method is not flexible enough and cannot meet the needs of users in different scenarios. In some scenarios, it will also affect the driving safety of users. Summary of the invention
[0003] The present application provides a control method, device and vehicle, which provide differentiated prompts based on different reasons when the vehicle exits the intelligent driving state, which helps to improve the flexibility of the prompt method and also helps to ensure the driving safety of the user.
[0004] In a first aspect, a control method is provided, the method comprising: detecting that a vehicle exits an intelligent driving state; when it is determined based on data collected by a sensor that the driver has caused the vehicle to exit the intelligent driving state due to an erroneous operation, controlling a first alarm device in the cockpit to alarm the driver; or, when it is determined based on data collected by the sensor that the driver has caused the vehicle to exit the intelligent driving state due to normal operation, controlling a first prompt device in the cockpit to prompt that the vehicle has exited the intelligent driving state.
[0005] Based on the above technical solution, when the driver's misoperation causes the vehicle to exit the intelligent driving state, the user can be warned, which can quickly draw the driver's attention and help ensure the user's driving safety. Alternatively, when the driver's normal operation causes the vehicle to exit the intelligent driving state, the user can only be prompted that the intelligent driving state has been exited, avoiding excessive interference to the user and helping to improve the user's driving experience.
[0006] In some possible implementations, the vehicle exits the intelligent driving state, including: the vehicle enters a lateral intervention state, wherein in the lateral intervention state the driver can control the movement of the vehicle in the lateral direction, and the vehicle is also controlled in the longitudinal direction.
[0007] In some possible implementations, controlling a first warning device in a cockpit to warn a driver includes: controlling the first warning device in the cockpit to send a first warning message, where the first warning message is used to increase the driver's attention.
[0008] In some possible implementations, when it is determined based on data collected by sensors that the driver has caused the vehicle to exit the intelligent driving state due to an error in operation, a first alarm device in the cockpit is controlled to warn the driver, including: when it is determined based on data collected by sensors that the driver has caused the vehicle to exit the intelligent driving state due to an error in operation and the driver's hands are removed from the vehicle are detected, the first alarm device in the cockpit is controlled to warn the driver of hands-off behavior.
[0009] The above driver's hands-off can be understood as the driver not holding the steering wheel.
[0010] In combination with the first aspect, in certain implementations of the first aspect, determining, based on data collected by the sensor, that the driver caused the vehicle to exit the intelligent driving state due to an error in operation, includes: obtaining risk assessment information based on the data collected by the sensor, the risk assessment information including one or more of environmental information around the vehicle, the driving status of the vehicle, and the status of the driver; when the risk assessment information meets a first preset condition, determining that the driver caused the vehicle to exit the intelligent driving state due to an error in operation.
[0011] Based on the above technical solution, risk assessment information can be obtained through the data collected by the sensor, and it can be determined whether the driver has caused the vehicle to exit the intelligent driving state due to misoperation. If it is determined that the driver has caused the vehicle to exit the intelligent driving state due to misoperation, a differentiated warning can be issued to quickly draw the driver's attention back, which helps to ensure the user's driving safety.
[0012] In some possible implementations, when the risk assessment information meets a first preset condition, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation, including: when it is determined based on the risk assessment information that the driver's driving behavior is inconsistent with the driver's normal driving habits, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation.
[0013] In some possible implementations, the driving state of the vehicle includes information on the steering wheel rotation amplitude, the vehicle's position information or the vehicle's predicted trajectory, and the environmental information includes lane line information and the curvature of the curve on which the vehicle is located. The above driving behaviors that are inconsistent with the driver's normal driving habits include: when the vehicle exits the intelligent driving state, the steering wheel rotation amplitude within a preset time is greater than or equal to a preset threshold; the vehicle deviates from the center line of the lane within a preset time from the time the vehicle exits the intelligent driving state; or, within a preset time from the time the vehicle exits the intelligent driving state, the curvature of the vehicle's predicted trajectory does not match the curvature of the curve on which the vehicle is located.
[0014] In combination with the first aspect, in certain implementations of the first aspect, the driving state of the vehicle includes the position of the vehicle in a first lane, and the environmental information includes information of the first lane, wherein when the risk assessment information satisfies a first preset condition, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation, including: when the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, or when the time for which the vehicle crosses the lane line is greater than or equal to a preset time, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation.
[0015] Based on the above technical solution, it is possible to determine whether the driver has caused the vehicle to exit the intelligent driving state due to a misoperation based on whether the vehicle has deviated from the center line of the lane or whether the vehicle has been driving on the lane for a long time. If it is determined that the driver has caused the vehicle to exit the intelligent driving state due to a misoperation, a differentiated warning can be issued to quickly draw the driver's attention back, which helps to ensure the user's driving safety.
[0016] In some possible implementations, if the distance that the vehicle's position in the first lane deviates from the center line of the first lane is greater than or equal to a first preset distance, it is determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation, including: detecting that the vehicle's position in the first lane deviates from the center line of the first lane by a distance greater than or equal to the first preset distance within a preset time since the vehicle exits the intelligent driving state, and determining that the vehicle exits the intelligent driving state due to misoperation of the driver.
[0017] In some possible implementations, when the duration for which the vehicle crosses the lane line is greater than or equal to a preset duration, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation, including: within a first preset duration from the time the vehicle exits the intelligent driving state, detecting that the duration for which the vehicle crosses the lane line is greater than or equal to a second preset duration, and determining that the driver caused the vehicle to exit the intelligent driving state due to a misoperation.
[0018] In combination with the first aspect, in certain implementations of the first aspect, controlling a first alarm device in a cockpit to warn a driver comprises: when the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, controlling the first alarm device in the cockpit to warn the driver at a first alarm level; wherein the method further comprises: when the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a second preset distance, controlling a second alarm device in the cockpit to warn the driver at a second alarm level, the second preset distance being greater than the first preset distance, and the second alarm level being higher than the first alarm level.
[0019] Based on the above technical solution, when the vehicle deviates from the center line of the lane by a relatively close distance, the driver can be warned at the first warning level, and when the vehicle deviates from the center line of the lane by a relatively long distance, the driver can be warned at the second warning level. In this way, by gradually increasing the warning level, it is helpful to quickly draw the driver's attention back and also helps to ensure the driving safety of users.
[0020] In some possible implementations, when the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, the first warning device in the cockpit is controlled to warn the driver at a first warning level, including: when the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to the first preset distance and the driver is detected to have taken his hands off the vehicle, the first warning device in the cockpit is controlled to warn the driver at the first warning level to take his hands off the vehicle.
[0021] In combination with the first aspect, in certain implementations of the first aspect, before determining that the driver caused the vehicle to exit the intelligent driving state due to misoperation, the method also includes: determining the first preset distance based on the driver's historical driving habits.
[0022] Based on the above technical solution, the threshold value can be dynamically adjusted by learning the driver's historical driving habits. For example, when the driver often does not drive in the center during manual driving of the vehicle, a smaller preset distance can be set. In this way, when it is determined that the driver has exited the intelligent driving state due to misoperation and the distance that the vehicle deviates from the center line of the lane is greater than the preset distance, the driver can be warned immediately to improve the driver's attention, which helps to avoid safety accidents caused by the vehicle deviating from the center line of the lane, and helps to improve the user's driving safety.
[0023] In combination with the first aspect, in certain implementations of the first aspect, the driving state of the vehicle includes the curvature of the predicted trajectory of the vehicle, and the environmental information includes the curvature of a first curve on which the vehicle is located, wherein when the risk assessment information satisfies a first preset condition, it is determined that the driver caused the vehicle to exit the intelligent driving state due to an error in operation, including: when the curvature of the predicted trajectory does not match the curvature of the first curve, it is determined that the driver caused the vehicle to exit the intelligent driving state due to an error in operation.
[0024] Based on the above technical solution, when the curvature of the predicted trajectory does not match the curvature of the first curve, it can be determined that the driver has caused the vehicle to exit the intelligent driving state due to misoperation. This can warn the driver and avoid safety accidents of the vehicle at the curve, which helps to improve the driving safety of users.
[0025] In some possible implementations, when the curvature of the predicted trajectory does not match the curvature of the first curve, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation, including: when it is detected that the duration of the mismatch between the curvature of the predicted trajectory and the curvature of the first curve is greater than or equal to a fourth preset time length within a third preset time length from the time the vehicle exits the intelligent driving state, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation.
[0026] In combination with the first aspect, in certain implementations of the first aspect, when the risk assessment information meets the first preset condition, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation, including: when the driver's state indicates that the driver is in a distracted state, a fatigued state, or the driver has performed one or more of dangerous actions, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation.
[0027] Based on the above technical solution, when it is detected that the driver is distracted, fatigued, or has one or more of the following dangerous actions, it can be determined that the driver has caused the vehicle to exit the intelligent driving state due to a misoperation. In this way, by warning the driver, it is helpful to quickly draw the driver's attention, help avoid safety accidents caused by the driver's poor condition, and help improve the user's driving experience.
[0028] In combination with the first aspect, in certain implementations of the first aspect, controlling a first warning device in the cockpit to warn the driver includes: when it is determined based on data collected by the sensor that the driver is out of the loop, controlling the first warning device to issue a hands-off warning to the driver at a third warning level within a first time period; wherein the method also includes: if it is detected that the driver is continuously out of the loop within the first time period, at the end of the first time period, controlling the first warning device to issue a hands-off warning to the driver at a fourth warning level, the fourth warning level being higher than the third warning level.
[0029] Based on the above technical solution, if the driver is detected to be continuously out of the loop during the first time period of the third warning level, the driver can be warned at the fourth warning level after the first time period. This helps to improve the driver's attention and reduce the risk of driver's misoperation; at the same time, it helps to avoid safety accidents caused by the vehicle exiting the intelligent driving state and the driver being out of the loop, and helps to improve the user's driving experience.
[0030] In some possible implementations, the driver is continuously out of the ring, including: the driver is continuously in a hands-free state.
[0031] In some possible implementations, the method further includes: determining the first time period based on environmental information around the vehicle. Exemplarily, the duration of the first time period determined when the environmental risk level around the vehicle is low environmental risk is greater than the duration of the first time period determined when the environmental risk level around the vehicle is low-high environmental risk.
[0032] In a second aspect, a control device is provided, which includes a detection unit, a determination unit and a control unit, wherein the detection unit is used to detect that the vehicle exits an intelligent driving state; the control unit is used to control a first alarm device in the cockpit to alarm the driver when the determination unit determines, based on data collected by the sensor, that the driver has caused the vehicle to exit the intelligent driving state due to an erroneous operation; or, when it is determined, based on data collected by the sensor, that the driver has caused the vehicle to exit the intelligent driving state due to normal operation, the control unit controls the first prompt device in the cockpit to prompt that the vehicle has exited the intelligent driving state.
[0033] In combination with the second aspect, in certain implementations of the second aspect, the device also includes an acquisition unit, which is used to obtain risk assessment information based on data collected by the sensor, and the risk assessment information includes one or more of environmental information around the vehicle, the driving status of the vehicle, and the status of the driver; the determination unit is specifically used to: when the risk assessment information meets a first preset condition, determine that the driver caused the vehicle to exit the intelligent driving state due to an erroneous operation.
[0034] In combination with the second aspect, in certain implementations of the second aspect, the driving status indicates the position of the vehicle in the first lane, the environmental information includes information of the first lane, and the determination unit is specifically used to determine that the driver caused the vehicle to exit the intelligent driving state due to an erroneous operation when the distance where the position of the vehicle in the first lane deviates from the center line of the first lane is greater than or equal to a first preset distance, or when the time for the vehicle to cross the lane line is greater than or equal to a preset time.
[0035] In combination with the second aspect, in certain implementations of the second aspect, the control unit is specifically used to: when the vehicle's position in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, control the first alarm device in the cockpit to alarm the user at a first alarm level; when the vehicle's position in the first lane deviates from the center line of the first lane by a distance greater than or equal to a second preset distance, control the second alarm device in the cockpit to alarm the user at a second alarm level, the second preset distance being greater than the first preset distance, and the second alarm level being higher than the first alarm level.
[0036] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is further used to determine the first preset distance based on the driver's historical driving habits.
[0037] In combination with the second aspect, in certain implementations of the second aspect, the driving state of the vehicle includes the curvature of the predicted trajectory of the vehicle, the environmental information includes the curvature of the first curve on which the vehicle is located, and the determination unit is specifically used to determine that the driver caused the vehicle to exit the intelligent driving state due to an incorrect operation when the curvature of the predicted trajectory does not match the curvature of the first curve.
[0038] In combination with the second aspect, in certain implementations of the second aspect, the determination unit is specifically used to determine that the driver caused the vehicle to exit the intelligent driving state due to an erroneous operation when the driver's status indicates that the driver is in a distracted state, a fatigued state, or the driver has performed one or more dangerous actions.
[0039] In combination with the second aspect, in certain implementations of the second aspect, the control unit is specifically used to: when it is determined that the driver is out of the loop based on data collected by the sensor, control the first warning device to issue a hands-off warning to the driver at a third warning level within a first time period; if it is detected that the driver is continuously out of the loop within the first time period, at the end of the first time period, control the first warning device to issue a hands-off warning to the driver at a fourth warning level, and the fourth warning level is higher than the third warning level.
[0040] In a third aspect, a control device is provided, which includes a memory and a processor, the memory being used to store a computer program, and the processor being used to execute the computer program in the memory, so that the control device can implement the method in any possible implementation manner of the above-mentioned first aspect.
[0041] In a fourth aspect, a control system is provided, which includes a warning device and a control device described in any one of the second aspect or the third aspect.
[0042] In some possible implementations, the control system also includes a perception system.
[0043] In a fifth aspect, a vehicle is provided, comprising a possible control device of any one of the second aspect or the third aspect, or comprising the control system described in the fourth aspect.
[0044] The vehicle in the present application is a vehicle in a broad sense, which can be a means of transportation (such as commercial vehicles, passenger cars, motorcycles, flying cars, trains, etc.), industrial vehicles (such as forklifts, trailers, tractors, etc.), engineering vehicles (such as excavators, bulldozers, cranes, etc.), agricultural equipment (such as mowers, harvesters, etc.), amusement equipment, toy vehicles, etc. The embodiments of the present application do not specifically limit the type of vehicle.
[0045] In a sixth aspect, a computer program product is provided, the computer program product comprising: a computer program code, when the computer program code is run on a computer, the computer executes the method in any possible implementation of the first aspect.
[0046] In a seventh aspect, a computer-readable storage medium is provided, wherein the computer-readable medium stores a computer program, and when the computer program runs on a computer, the computer executes the method in any possible implementation of the first aspect.
[0047] In an eighth aspect, a chip is provided, the chip comprising a circuit for executing the method in any possible implementation of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0048] Figure 1 It is a functional block diagram of a vehicle provided in an embodiment of the present application.
[0049] Figure 2 It is a schematic block diagram of the intelligent driving system provided in an embodiment of the present application.
[0050] Figure 3 It is a schematic flow chart of the control method provided in the embodiment of the present application.
[0051] Figure 4 It is the human-machine interface HMI provided in the embodiment of the present application.
[0052] Figure 5 It is another HMI provided by the embodiment of the present application.
[0053] Figure 6 It is another HMI provided by the embodiment of the present application.
[0054] Figure 7 It is a schematic diagram of an application scenario provided by an embodiment of the present application.
[0055] Figure 8 It is another schematic diagram of the application scenario provided by the embodiment of the present application.
[0056] Fig. 9 It is a schematic diagram of the intelligent driving scenario provided in an embodiment of the present application.
[0057] Fig.10 It is a schematic block diagram of a control device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0058] The technical solutions in the embodiments of the present application will be described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. "At least one" means one or more. For example, "at least one of A and B" is similar to "A and / or B", describing the association relationship of associated objects, indicating that three relationships can exist, for example, at least one of A and B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0059] In the embodiments of the present application, prefixes such as "first" and "second" are used only to distinguish different description objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects. The use of prefixes such as ordinal numbers to distinguish description objects in the embodiments of the present application does not constitute a limitation on the described objects. For the statement of the described objects, please refer to the description in the context of the claims or embodiments, and no unnecessary limitation should be constituted due to the use of such prefixes. In addition, in the description of the present embodiment, unless otherwise specified, the meaning of "multiple" is two or more.
[0060] Figure 1 It is a functional block diagram of a vehicle 100 provided in an embodiment of the present application. The vehicle 100 may include a perception system 110, a computing platform 120 and a display device 130, wherein the perception system 110 may include one or more sensors for sensing information about the environment around the vehicle 100. For example, the perception system 110 may include a positioning system, and the positioning system may be a global positioning system (GPS), or a Beidou system or other positioning systems. For another example, the perception system 110 may include one or more of an inertial measurement unit (IMU), an accelerometer, a laser radar, a millimeter wave radar, an ultrasonic radar, and a camera device.
[0061] Some or all functions of the vehicle 100 may be controlled by the computing platform 120. The computing platform 120 may include one or more processors, such as processors 121 to 12n (n is a positive integer). The processor is a circuit with signal processing capability. In one implementation, the processor may be a circuit with instruction reading and execution capability, such as a central processing unit (CPU), a microprocessor, a graphics processing unit (GPU) (which may be understood as a microprocessor), or a digital signal processor (DSP). In another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit may be fixed or reconfigurable, such as a hardware circuit implemented by a processor such as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field programmable gate array (FPGA). In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the hardware circuit configuration may be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, the processor may also be a hardware circuit designed for artificial intelligence, which may be understood as an ASIC, such as a neural network processing unit (NPU), a tensor processing unit (TPU), a deep learning processing unit (DPU), etc. In addition, the computing platform 120 may also include a memory, the memory is used to store instructions, and some or all of the processors 121 to 12n may call instructions in the memory to implement corresponding functions.
[0062] The display device 130 in the cockpit is mainly divided into two categories. The first category is the vehicle display screen; the second category is the projection display screen, such as a head up display (HUD). The vehicle display screen is a physical display screen and an important part of the vehicle infotainment system. Multiple display screens can be set in the cockpit, such as a digital instrument display screen, a central control screen, a display screen in front of the passenger in the co-pilot seat (also called the front passenger), a display screen in front of the left rear passenger, and a display screen in front of the right rear passenger. Even the window can be used as a display screen for display. Head-up display, also known as a head-up display system. It is mainly used to display driving information such as speed and navigation on a display device in front of the driver (such as a windshield). To reduce the driver's line of sight transfer time, avoid pupil changes caused by the driver's line of sight transfer, and improve driving safety and comfort. HUD includes, for example, a combined head-up display (C-HUD) system, a windshield head-up display (W-HUD) system, and an augmented reality head-up display system (AR-HUD). It should be understood that other types of HUD systems may appear as technology evolves, and this application is not limited to this.
[0063] The above display device 130 is described by taking a vehicle-mounted display screen and a projection display screen as examples, and the embodiments of the present application are not limited thereto. For example, the display device 130 can also be a light display screen or a projection screen.
[0064] Optionally, the structure of the above vehicle 100 is merely illustrative, and in actual applications, various components in the above vehicle 100 may be added or deleted according to actual needs.
[0065] Vehicle 100 may include an intelligent driving system, which may include an advanced driving assistant system (ADAS) and an autonomous driving system (ADS). The intelligent driving system utilizes a variety of sensors on the vehicle (including but not limited to: lidar, millimeter wave radar, camera device, ultrasonic sensor, global positioning system, inertial measurement unit) to obtain information from the surroundings of the vehicle, and analyzes and processes the obtained information to achieve functions such as obstacle perception, target recognition, vehicle positioning, path planning, driver monitoring / reminder, etc., thereby improving the safety, automation and comfort of vehicle driving.
[0066] For example, Figure 2A schematic block diagram of an intelligent driving system provided by an embodiment of the present application is shown. The intelligent driving system may include three functional modules: a perception module 210, a planning module 220, and a control module 230, wherein the perception module 210 perceives the surrounding environment of the vehicle body through sensors and outputs corresponding perception data to the planning module 220. The planning module 220 obtains information about road elements based on the information obtained by the perception module 210. The planning module 220 may determine the physical connectivity of the vehicle from the current position to the sampling point based on the current position of the vehicle and the information of the road elements, and when the vehicle is physically connected from the current position to a certain sampling point, plan the driving trajectory of the vehicle to the sampling point. The planning module 220 may determine the strategy space of the vehicle based on the driving trajectory. The planning module 220 may send the strategy space to the control module 230. The control module 230 may evaluate in the Euclidean space based on the strategy space, thereby making behavioral decisions or interactive decisions for the vehicle.
[0067] The above perception module 210 , planning module 220 and control module 230 may be located in the above computing platform 120 .
[0068] Based on the degree to which the vehicle-based driving automation system can perform dynamic driving tasks, driving automation is divided into levels 0 to 5 (or L0-L5) according to the role allocation in performing dynamic driving tasks and the presence or absence of design operating domain (ODD), such as the external conditions applicable to the functional operation of the driving automation system determined when the driving automation system is designed, such as roads, traffic, weather, lighting, etc.). Among the 6 levels of driving automation, levels 0-2 are driving assistance, the system assists humans in performing dynamic driving tasks, and the driving subject is still the driver; levels 3-5 are automatic driving, the system replaces humans to perform dynamic driving tasks under the designed operating conditions, and when the function is activated, the driving subject is the system. The names and definitions of each level are as follows:
[0069] Level 0 driving automation (also known as emergency assistance) systems cannot continuously perform lateral or longitudinal motion control of the vehicle in dynamic driving tasks, but have the ability to continuously perform partial target and event detection and response in dynamic driving tasks. Level 1 driving automation (also known as partial driver assistance) systems continuously perform lateral or longitudinal motion control of the vehicle in dynamic driving tasks under their designed operating conditions, and have the ability to detect and respond to partial targets and events that are compatible with the lateral or longitudinal motion control of the vehicle performed. Level 2 driving automation (also known as combined driver assistance) systems continuously perform lateral and longitudinal motion control of the vehicle in dynamic driving tasks under their designed operating conditions, and have the ability to detect and respond to partial targets and events that are compatible with the lateral and longitudinal motion control of the vehicle performed. Level 3 driving automation (also known as conditionally automated driving) systems continuously perform all dynamic driving tasks under their designed operating conditions. Level 4 driving automation (also known as highly automated driving) systems continuously perform all dynamic driving tasks under their designed operating conditions and automatically implement minimum risk strategies. Level 5 driving automation (also known as fully automated driving) systems continuously perform all dynamic driving tasks and automatically implement minimal risk strategies under any drivable conditions. Generally, intelligent driving systems generally belong to L2-L5, such as ADAS belongs to L2, and ADS belongs to L3-L5.
[0070] Figure 3 A schematic flow chart of a control method 300 provided in an embodiment of the present application is shown. The method 300 may be executed by the vehicle 100, or the computing platform 120, or the processor, chip or circuit in the computing platform 120; or the intelligent driving system. The method 300 includes:
[0071] S310, detecting that the vehicle exits the intelligent driving state.
[0072] Optionally, before detecting that the vehicle exits the intelligent driving state, the method 300 includes: determining that the vehicle is in the intelligent driving state; wherein, detecting that the vehicle exits the intelligent driving state includes: when a first operation of the user is detected, controlling the vehicle to exit the intelligent driving state.
[0073] Optionally, determining that the vehicle is in an intelligent driving state includes: upon detecting an instruction from a user to turn on the intelligent driving function, controlling the vehicle to enter the intelligent driving state.
[0074] Exemplarily, the intelligent driving functions include: intelligent navigation cruise assist (NCA) function, lane centering control (LCC), adaptive cruise control (ACC), automatic lane keeping (ALK), L3 highway automatic driving, L3 urban trunk and branch road automatic driving, automatic parking assist (APA) function, remote parking assist (RPA) function or autonomous parking (AVP) function, etc.
[0075] Optionally, the first operation may be an operation of the user turning the steering wheel, or the first operation may be an operation of the user stepping on the brake pedal. Exemplarily, when the vehicle is in the intelligent driving state, when the user turns the steering wheel and the steering wheel rotation angle is greater than or equal to the preset angle, or the torque on the steering wheel is greater than or equal to the preset torque, the vehicle can be controlled to exit the intelligent driving state, or the vehicle can be controlled to be in the lateral intervention state. For example, in the lateral intervention state, the driver can control the lateral movement of the vehicle, while in the longitudinal direction, the vehicle still controls the longitudinal driving state of the vehicle (for example, speed, acceleration, etc.).
[0076] The above horizontal intervention state can also be called the horizontal connection state.
[0077] Exemplarily, when the vehicle is in the intelligent driving state, if it is detected that the user steps on the brake pedal and the pedal travel of the brake pedal is greater than or equal to a preset travel (for example, 5%), the vehicle can be controlled to exit the intelligent driving state.
[0078] S320, when it is determined based on the data collected by the sensor that the driver has caused the vehicle to exit the intelligent driving state due to an erroneous operation, the first alarm device in the cockpit is controlled to alarm the driver; or, when it is determined based on the data collected by the sensor that the driver has caused the vehicle to exit the intelligent driving state due to normal operation, the first prompt device in the cockpit is controlled to prompt that the vehicle has exited the intelligent driving state.
[0079] Exemplarily, the sensor includes, but is not limited to, one or more of a camera outside the cockpit, a millimeter-wave radar, a lidar, or a camera inside the cockpit.
[0080] Optionally, controlling a first warning device in the cockpit to warn the driver includes: controlling the first warning device in the cockpit to send a first warning message, wherein the first warning message is used to prompt the driver to concentrate.
[0081] Optionally, when it is determined based on data collected by the sensor that the driver has caused the vehicle to exit the intelligent driving state due to an error in operation, the first alarm device in the cockpit is controlled to warn the driver, including: when it is determined based on data collected by the sensor that the driver has caused the vehicle to exit the intelligent driving state due to an error in operation and the driver's hands are removed from the vehicle are detected, the first alarm device in the cockpit is controlled to warn the driver of hands-off.
[0082] For example, Figure 4 The human machine interface (HMI) provided by the embodiment of the present application is shown.
[0083] like Figure 4 As shown, the vehicle is in the intelligent driving state (for example, the NCA function of the vehicle is turned on). When it is detected that the vehicle exits the intelligent driving state due to driver's misoperation and the driver's hands are off the steering wheel, the central control screen can be controlled to display a prompt message "Please hold the steering wheel, intelligent navigation has been exited", the warning color (yellow) can be controlled above the central control screen, and the speakers in the cockpit can be controlled to emit a warning sound "Please hold the steering wheel".
[0084] Optionally, controlling a first warning device in the cockpit to warn the driver includes: when it is determined based on data collected by the sensor that the driver is out of the loop, controlling the first warning device to issue a hands-off warning to the driver at a third warning level within a first time period; wherein the method 300 also includes: if it is detected that the driver is continuously out of the loop within the first time period, at the end of the first time period, controlling the first warning device to issue a hands-off warning to the driver at a fourth warning level, the fourth warning level being higher than the third warning level.
[0085] For example, Figure 5 The HMI provided by the embodiment of the present application is shown.
[0086] The vehicle is in the intelligent driving state (for example, the NCA function of the vehicle is turned on). When it is detected that the driver has exited the intelligent driving state due to a misoperation and the driver is in the hands-free state, the vehicle can control the warning device in the cockpit to Figure 4 The alarm level shown in the figure is used to generate an alarm. Figure 4 If the driver is detected to have taken his hands off the vehicle for a period of time (e.g., 10 seconds) after the warning method shown in the figure warns, the vehicle can Figure 5The alarm level shown is used to generate an alarm. Figure 5 As shown, the vehicle can control the central control screen to display the prompt message "Please hold the steering wheel, smart navigation has exited", control the warning color (red) displayed above the central control screen, control the speakers in the cockpit to emit a warning sound "Please hold the steering wheel" and control the seat belt to tighten.
[0087] above Figure 5 The warning level shown is higher than Figure 4 The higher the warning level, the higher the warning level, and the more sensitive the driver will be to the warning of the warning device.
[0088] Exemplarily, the vehicle detects that the driver's hands are continuously off the wheel, including: detecting that the torque of the steering wheel is continuously less than or equal to a preset torque (for example, 0.8 Nm) for a period of time; or, taking the steering wheel as a capacitive steering wheel as an example, the vehicle detects that the driver is continuously out of the loop, including: detecting that the user is not gripping the capacitive steering wheel for a period of time.
[0089] For example, Figure 6 The HMI provided by the embodiment of the present application is shown.
[0090] like Figure 6 As shown, the vehicle is in the intelligent driving state (for example, the NCA function of the vehicle is turned on). When it is detected that the vehicle exits the intelligent driving state due to normal operation by the user, the central control screen can be controlled to display a prompt message "Intelligent Navigation has exited" and the speakers in the cockpit can be controlled to emit a prompt tone "Intelligent Navigation has exited".
[0091] Exemplarily, within a preset time (e.g., 10s) from the time the vehicle exits the intelligent driving state, when it is detected that the driver is in good condition and the driver's driving behavior is consistent with the driver's normal driving habits, it can be determined that the driver caused the vehicle to exit the intelligent driving state due to normal operation.
[0092] Optionally, determining that the driver caused the vehicle to exit the intelligent driving state due to misoperation based on data collected by the sensor includes: obtaining risk assessment information based on the data collected by the sensor, the risk assessment information including one or more of environmental information around the vehicle, the driving status of the vehicle, and the status of the driver; when the risk assessment information meets a first preset condition, determining that the driver caused the vehicle to exit the intelligent driving state due to misoperation.
[0093] Exemplarily, the driver's state includes one or more of a distracted state, a fatigued state, or a dangerous action. For example, the dangerous action includes smoking, making phone calls, eating, and the like.
[0094] For example, the fatigue state can be represented by a fatigue level. If it is detected that the driver's eyes are closed for a duration greater than or equal to 20 seconds from the start of the driving journey to the current moment, it can be determined that the driver is at a high fatigue level; or if the driver's eyes are closed for a duration less than 20 seconds, it can be determined that the driver is at a low fatigue level.
[0095] For example, the distraction state can be represented by a distraction level. For example, when it is detected that the vehicle exits the intelligent driving state, if the driver is turning his head to talk to the rear passenger, it can be determined that the driver is at a high distraction level; or, when it is detected that the vehicle exits the intelligent driving state, if the driver's eye sight direction is consistent with the vehicle's driving direction, it can be determined that the driver is at a low distraction level.
[0096] For example, the driver's status can also include physiological indicators such as the driver's heart rate and breathing rate to detect potential health problems in advance. If there are potential health problems, they may affect the driving safety of users in the cabin.
[0097] Exemplarily, the evaluation result of the driver's state may be classified as the driver's state being good or the driver's state being bad.
[0098] For example, the driver's good state can be understood as the driver having no dangerous actions, a low distraction level, a good health status, and a low fatigue level.
[0099] For another example, the poor condition of the driver may be understood as one or more of the following: the driver has dangerous actions, the distraction level is a high distraction level, the health condition is poor, and the fatigue level is a high fatigue level.
[0100] Exemplarily, the environmental information around the vehicle includes one or more of information about the road on which the vehicle is located (for example, whether the vehicle is on a curve or a straight road, information about the lane lines of the vehicle's lane, the type of road surface, the curvature of the curve, etc.), information about surrounding obstacles (for example, the position, speed, acceleration, etc. of other vehicles around the vehicle), and weather conditions (for example, snowy days, rainy days, sunny days, etc.).
[0101] Exemplarily, the environmental risk level around the vehicle may include a high environmental risk and a low environmental risk.
[0102] For example, taking the vehicle speed as 100km / h, when the distance between the dynamic targets around the vehicle (for example, other vehicles) and the vehicle is greater than or equal to 30m, the environmental risk around the vehicle can be determined as a low environmental risk; or, when the distance between the dynamic targets around the vehicle (for example, other vehicles) and the vehicle is less than 30m, the environmental risk around the vehicle can be determined as a high environmental risk.
[0103] For another example, when the weather condition in the vehicle's environment is snowing or raining, the environmental risk around the vehicle can be determined to be a high environmental risk; or, when the weather condition in the vehicle's environment is sunny, the environmental risk around the vehicle can be determined to be a low environmental risk.
[0104] For another example, the environmental risk level around the vehicle can also be determined by the road conditions. For example, the vehicle can be determined to be at a high environmental risk under the following road conditions:
[0105] (1) The vehicle is on a curve, an irregular intersection, a road with unclear lane lines, or an occupied road;
[0106] (2) The vehicle is in a congested section, there are large vehicles passing by the vehicle, or there are other vehicles around the vehicle that are changing lanes (cutin) to the lane where the vehicle is located;
[0107] (3) The vehicle is located on a road with potholes or water accumulation (for example, due to potholes or water accumulation caused by previous rain), or the vehicle is located in a scene with poor lighting conditions (for example, a dark scene at night).
[0108] Exemplarily, the driving state of the vehicle includes one or more of the vehicle's position, speed, acceleration, and heading angle.
[0109] Optionally, the road information includes information of a first lane where the vehicle is located, the driving status indicates the position of the vehicle in the first lane, and the environmental information includes information of the first lane, wherein when the risk assessment information satisfies a first preset condition, it is determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation, including: when the vehicle's position in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, or when the vehicle travels across the lane line for a time greater than or equal to a preset time 1, it is determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation.
[0110] Exemplarily, the preset duration 1 can be determined according to different scenarios. For example, when the vehicle just crosses the lane line, the risk may be greater, and the preset duration 1 may be shorter. For another example, when the vehicle is in a high risk environment, the preset duration 1 may be shorter; or, when the vehicle is in a low risk environment, the preset duration 1 may be longer.
[0111] Optionally, when the distance that the position of the vehicle in the first lane deviates from the center line of the first lane is greater than or equal to a first preset distance, determining that the driver caused the vehicle to exit the intelligent driving state due to a misoperation includes: when the distance that the position of the vehicle in the first lane deviates from the center line of the first lane is greater than or equal to the first preset distance for a duration greater than or equal to a preset duration 2, determining that the driver caused the vehicle to exit the intelligent driving state due to a misoperation. Exemplarily, the preset duration 2 is 3s.
[0112] Exemplarily, the preset duration 2 may be determined by the environmental risk level of the vehicle. For example, when the vehicle is in a high environmental risk, the preset duration 2 may be shorter; or, when the vehicle is in a low risk environment, the preset duration 2 may be longer.
[0113] For example, Figure 7 and Figure 8 Schematic diagrams of application scenarios provided by the embodiments of the present application are respectively shown.
[0114] like Figure 7 As shown, when the vehicle exits the intelligent driving state, the position of the vehicle and the position of the lane line can be determined through the data collected by the sensors outside the cockpit. Within 10 seconds after the vehicle exits the intelligent driving state, if it is detected that the distance that the vehicle deviates from the center line of the lane is greater than a first preset distance (for example, 0.6m), it can be determined that the driver has misoperated and caused the vehicle to exit the intelligent driving state. The vehicle can control the warning device to issue the following Figure 4 The warning information shown.
[0115] like Figure 8 As shown, when the vehicle exits the intelligent driving state, the position of the vehicle and the position of the lane line can be determined through the data collected by the sensors outside the cockpit. Within 10 seconds from the time the vehicle exits the intelligent driving state, if it is detected that the vehicle crosses the lane line for a time period greater than or equal to a preset time period (for example, 5 seconds), it can be determined that the driver has made a mistake in operation and caused the vehicle to exit the intelligent driving state. The vehicle can control the warning device to issue the following Figure 4 The warning information shown.
[0116] Optionally, controlling a first alarm device in the cockpit to warn the driver includes: when the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, controlling the first alarm device in the cockpit to warn the user at a first alarm level; wherein the method also includes: when the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a second preset distance, controlling a second alarm device in the cockpit to warn the user at a second alarm level, the second preset distance being greater than the first preset distance, and the second alarm level being higher than the first alarm level.
[0117] For example, the first preset distance is 0.6m, and the second preset distance is 1m. If it is detected within 10s from the time the vehicle exits the intelligent driving state that the position of the vehicle in the first lane deviates from the center line of the first lane by more than 0.6m and the driver lets go, the following method can be used: Figure 4 The following warning method is used to warn the driver of the hands-off state; within 10 seconds after the vehicle exits the intelligent driving state, when it is detected that the position of the vehicle in the first lane deviates from the center line of the first lane by more than 1m and the driver lets go of the hands-off state, the following warning method can be used: Figure 5 The hands-free warning is given in the warning mode shown.
[0118] Optionally, when the distance that the position of the vehicle in the first lane deviates from the center line of the first lane is greater than or equal to the second preset distance, the second alarm device in the cockpit is controlled to warn the user with the second alarm level, including: when the duration that the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to the second preset distance is greater than or equal to the preset duration 3, the second alarm device in the cockpit is controlled to warn the user with the second alarm level. Optionally, the preset duration 3 can be determined by environmental information around the vehicle. For example, when the environmental risk level around the vehicle is low environmental risk, the preset duration 3 can be 3s. For another example, when the environmental risk level around the vehicle is high environmental risk, the preset duration 3 can be 1.5s.
[0119] Optionally, before determining that the vehicle exits the intelligent driving state due to a misoperation by the driver, method 300 further includes: determining the first preset distance according to the driver's historical driving habits.
[0120] For example, if the driver's historical driving habits indicate that in the past period of time (for example, within 1 month), when the vehicle was in manual driving, the ratio of the time the vehicle deviated from the center line of the lane by more than 0.6m to the time the vehicle was in manual driving was greater than a preset ratio (for example, 50%), it can be determined that the driver's driving habit is to frequently control the vehicle to drive out of the center. At this time, a smaller preset distance, for example, 0.4m, can be determined based on the historical driving habits. In this way, when it is detected that the vehicle deviates from the center line of the lane by a distance greater than or equal to 0.4m, the driver can be immediately warned, thereby ensuring that the driver quickly takes over the vehicle, which helps to improve the user's driving safety.
[0121] For example, if the driver's historical driving habits indicate that in the past period of time (for example, within 1 month), when the vehicle was in manual driving, the ratio of the time the vehicle deviated from the center line of the lane by less than 0.2m to the time the vehicle was in manual driving was greater than a preset ratio (for example, 90%), it can be determined that the driver's driving habit is to often control the vehicle to drive in the center. At this time, a larger preset distance can be determined based on the historical driving habits, for example, 0.6m. In this way, when it is detected that the vehicle deviates from the center line of the lane by a distance greater than or equal to 0.6m, the driver can be warned again to avoid premature warnings and causing trouble to the driver.
[0122] Optionally, the driving state of the vehicle includes the curvature of the predicted trajectory of the vehicle, and the environmental information includes the curvature of a first curve on which the vehicle is located, wherein when the risk assessment information satisfies a first preset condition, it is determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation, including: when the curvature of the predicted trajectory does not match the curvature of the first curve, it is determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation.
[0123] Optionally, when the curvature of the predicted trajectory does not match the curvature of the first curve, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation, including: when it is detected that the duration of the mismatch between the curvature of the predicted trajectory and the curvature of the first curve is greater than or equal to a preset time length 5 within a preset time length 4 from the time the vehicle exits the intelligent driving state, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation.
[0124] Exemplarily, the preset time length 4 may be 5 seconds.
[0125] Optionally, the above preset duration 5 may be determined by the curvature of the curve. For example, the greater the curvature of the curve, the shorter the preset duration 5 may be (e.g., 1.5 s); for another example, the smaller the curvature of the curve, the longer the preset duration 5 may be (e.g., 3 s).
[0126] For example, Fig. 9 A schematic diagram of an intelligent driving scenario provided by an embodiment of the present application is shown.
[0127] like Fig. 9 As shown, when it is detected that the curvature C1 of the predicted trajectory of the vehicle does not match the curvature C2 of the curve where the vehicle is located after the vehicle exits the intelligent driving state, it can be determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation.
[0128] Exemplarily, the curvature C1 of the predicted trajectory does not match the curvature C2 of the curve in which the vehicle is located, including: the difference between the curvature C1 of the predicted trajectory and the curvature C2 of the curve in which the vehicle is located is greater than or equal to a preset difference, or the ratio between the curvature C1 of the predicted trajectory and the curvature C2 of the curve in which the vehicle is located is greater than or equal to a preset ratio.
[0129] Optionally, when the risk assessment information meets a first preset condition, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation, including: when the driver's state indicates that the driver is in a distracted state, a fatigued state, or the driver has performed one or more of dangerous actions, it is determined that the driver caused the vehicle to exit the intelligent driving state due to a misoperation.
[0130] For example, when the driver is turning his head to talk to the user in the back seat or the user in the front passenger seat when the vehicle exits the intelligent driving state, it can be determined that the driver is in a distracted state; or, when the driver is making a phone call when the vehicle exits the intelligent driving state, it can be determined that the driver is in a distracted state.
[0131] Optionally, when the risk assessment information meets the first preset condition, determining that the driver caused the vehicle to exit the intelligent driving state due to a misoperation includes: when the driver's driving behavior does not conform to the driver's normal driving habits when exiting the intelligent driving state, determining that the driver caused the vehicle to exit the intelligent driving state due to a misoperation. Exemplarily, the driving behavior that does not conform to the driver's normal driving habits includes but is not limited to any one of violently turning the steering wheel, deviating from the lane, or curvature deviation when turning a curve.
[0132] Exemplary, the combination of environmental information around the vehicle, the driving state of the vehicle and the state judgment of the driver is taken as an example. The environment around the vehicle indicates that there is another vehicle at a certain distance in front of the vehicle, and the driving state of the vehicle indicates the speed of the vehicle when it exits the intelligent driving state. When the driver is detected to be out of the loop within a preset time (for example, 1s) from the time the vehicle enters the lateral intervention state, and the vehicle will rear-end another vehicle in the same lane at the current speed, the driver can be warned through the warning device.
[0133] Exemplarily, whether the driver is in the loop includes whether the driver is holding the steering wheel. Taking the steering wheel as a torque steering wheel as an example, when it is detected that the user driver is holding the steering wheel and applying a certain torque, it can be determined that the driver is in the loop; taking the steering wheel as a capacitive steering wheel as an example, when it is detected that the driver is lightly holding the capacitive steering wheel, it can be determined that the driver is in the loop.
[0134] Fig.10 A schematic block diagram of a control device 1000 provided in an embodiment of the present application is shown. The device 1000 includes a detection unit 1010, a determination unit 1020, and a control unit 1030, wherein the detection unit 1010 is used to detect that the vehicle exits the intelligent driving state; the control unit 1030 is used to control the first warning device in the cockpit to warn the driver when the determination unit 1020 determines that the driver has caused the vehicle to exit the intelligent driving state due to misoperation according to data collected by the sensor; or, when the determination unit 1020 determines that the driver has caused the vehicle to exit the intelligent driving state due to normal operation according to data collected by the sensor, control the first prompting device in the cockpit to prompt that the vehicle has exited the intelligent driving state.
[0135] Optionally, the device 1000 also includes an acquisition unit, which is used to obtain risk assessment information based on the data collected by the sensor, and the risk assessment information includes one or more of the environmental information around the vehicle, the driving status of the vehicle, and the status of the driver; the determination unit 1020 is specifically used to: when the risk assessment information meets a first preset condition, determine that the driver caused the vehicle to exit the intelligent driving state due to an erroneous operation.
[0136] Optionally, the driving status indicates the position of the vehicle in the first lane, the environmental information includes information of the first lane, and the determination unit 1020 is specifically used to determine that the driver caused the vehicle to exit the intelligent driving state due to misoperation when the distance where the position of the vehicle in the first lane deviates from the center line of the first lane is greater than or equal to a first preset distance, or when the time for which the vehicle crosses the lane line is greater than or equal to a preset time.
[0137] Optionally, the control unit 1030 is specifically used to: when the vehicle's position in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, control the first alarm device in the cockpit to alarm the user at a first alarm level; when the vehicle's position in the first lane deviates from the center line of the first lane by a distance greater than or equal to a second preset distance, control the second alarm device in the cockpit to alarm the user at a second alarm level, the second preset distance being greater than the first preset distance, and the second alarm level being higher than the first alarm level.
[0138] Optionally, the determination unit 1020 is further configured to determine the first preset distance according to the driver's historical driving habits.
[0139] Optionally, the driving state of the vehicle includes the curvature of the predicted trajectory of the vehicle, and the environmental information includes the curvature of the first curve on which the vehicle is located. The determination unit 1020 is specifically used to determine that the driver has caused the vehicle to exit the intelligent driving state due to an erroneous operation when the curvature of the predicted trajectory does not match the curvature of the first curve.
[0140] Optionally, the determination unit 1020 is specifically used to determine that the driver caused the vehicle to exit the intelligent driving state due to a misoperation of the driver when the driver's state indicates that the driver is in a distracted state, a fatigued state, or the driver has performed one or more dangerous actions.
[0141] Optionally, the control unit 1030 is specifically used to: when it is determined that the driver is out of the loop based on data collected by the sensor, control the first warning device to issue a hands-off warning to the driver at a third warning level within a first time period; if it is detected that the driver is continuously out of the loop within the first time period, at the end of the first time period, control the first warning device to issue a hands-off warning to the driver at a fourth warning level, and the fourth warning level is higher than the third warning level.
[0142] The functions implemented by the above detection unit 1010 can be implemented by the processor, chip or circuit in the above computing platform. For example, the functions implemented by the detection unit 1010 can be implemented by the processor 121. The processor 121 can control the vehicle to exit the intelligent driving state according to the driver's operation. For example, when the processor 121 detects that the torque applied by the user to the steering wheel is greater than the preset torque, the vehicle can be controlled to exit the intelligent driving state. For another example, when the processor 121 detects that the user steps on the brake pedal, the vehicle can be controlled to exit the intelligent driving state.
[0143] The functions implemented by the above determination unit 1020 may be implemented by a processor, chip or circuit in the above computing platform. For example, the functions implemented by the determination unit 1020 may be implemented by the processor 122. The processor 122 may determine whether the driver has caused the vehicle to exit the intelligent driving state due to misoperation based on the data collected by the sensor.
[0144] The functions implemented by the above control unit 1030 can be implemented by the processor, chip or circuit in the above computing platform. For example, the functions implemented by the control unit 1030 can be implemented by the processor 123. When the processor 122 determines that the driver has caused the vehicle to exit the intelligent driving state due to misoperation, the processor 123 can control the warning device to warn the user to enhance the user's attention. Alternatively, when the processor 122 determines that the driver has caused the vehicle to exit the intelligent driving state due to normal operation, the processor 123 can control the prompt device to prompt that the intelligent driving state has been exited.
[0145] The functions implemented by the above detection unit 1010, determination unit 1020 and control unit 1030 can be implemented by the same processor, or, can also be implemented by different processors, or, can also partially be implemented by the same processor, and the embodiments of the present application do not make specific limitations on this.
[0146] It should be understood that the division of the units in the above device is only a division of logical functions. In actual implementation, they can be fully or partially integrated into one physical entity, or they can be physically separated. In addition, the units in the device can be implemented in the form of a processor calling software; for example, the device includes a processor, the processor is connected to a memory, and instructions are stored in the memory. The processor calls the instructions stored in the memory to implement any of the above methods or realize the functions of the units of the device, wherein the processor is, for example, a general-purpose processor, such as a CPU or a microprocessor, and the memory is a memory in the device or a memory outside the device. Alternatively, the units in the device can be implemented in the form of hardware circuits, and the functions of some or all of the units can be realized by designing the hardware circuits. The hardware circuit can be understood as one or more processors; for example, in one implementation, the hardware circuit is an ASIC, and the functions of some or all of the above units are realized by designing the logical relationship of the components in the circuit; for another example, in another implementation, the hardware circuit can be implemented by PLD. Taking FPGA as an example, it can include a large number of logic gate circuits, and the connection relationship between the logic gate circuits is configured through the configuration file, so as to realize the functions of some or all of the above units. All units of the above device may be implemented entirely in the form of a processor calling software, or entirely in the form of a hardware circuit, or partially in the form of a processor calling software and the rest in the form of a hardware circuit.
[0147] In an embodiment of the present application, a processor is a circuit with the ability to process signals. In one implementation, the processor may be a circuit with the ability to read and run instructions, such as a CPU, a microprocessor, a GPU, or a DSP; in another implementation, the processor may implement certain functions through the logical relationship of a hardware circuit, and the logical relationship of the hardware circuit is fixed or reconfigurable, such as a hardware circuit implemented by an ASIC or PLD, such as an FPGA. In a reconfigurable hardware circuit, the process of the processor loading a configuration document to implement the configuration of the hardware circuit can be understood as the process of the processor loading instructions to implement the functions of some or all of the above units. In addition, it can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as an NPU, TPU, DPU, etc.
[0148] It can be seen that each unit in the above device can be one or more processors (or processing circuits) configured to implement the above method, such as: CPU, GPU, NPU, TPU, DPU, microprocessor, DSP, ASIC, FPGA, or a combination of at least two of these processor forms.
[0149] In addition, all or part of the units in the above device can be integrated together, or can be implemented independently. In one implementation, these units are integrated together and implemented in the form of SoC. The SoC may include at least one processor for implementing any of the above methods or implementing the functions of each unit of the device. The type of the at least one processor may be different, for example, including CPU and FPGA, CPU and artificial intelligence processor, CPU and GPU, etc.
[0150] An embodiment of the present application also provides a control device, which includes a processing unit and a storage unit, wherein the storage unit is used to store instructions, and the processing unit executes the instructions stored in the storage unit to enable the device to execute the method or steps executed in the above embodiment.
[0151] Optionally, if the control device is located in a vehicle, the processing unit may be Figure 1 One or more of the processors 121-12n are shown.
[0152] An embodiment of the present application also provides a control system, the intelligent driving system includes a perception system and a computing platform, and the computing platform includes the above-mentioned control device.
[0153] An embodiment of the present application also provides a vehicle, which may include the above-mentioned control device or the above-mentioned control system.
[0154] The embodiment of the present application further provides a computer program product, which includes: a computer program code, and when the computer program code is executed on a computer, the computer executes the method in the above embodiment.
[0155] The embodiment of the present application further provides a computer-readable medium, wherein the computer-readable medium stores a program code. When the computer program code runs on a computer, the computer executes the method in the above embodiment.
[0156] An embodiment of the present application further provides a chip, wherein the chip includes a circuit, and the circuit is used to execute the method in the above embodiment.
[0157] In the implementation process, each step of the above method can be completed by an integrated logic circuit of hardware in a processor or an instruction in the form of software. The method disclosed in conjunction with the embodiment of the present application can be directly embodied as a hardware processor for execution, or a combination of hardware and software modules in a processor for execution. The software module can be located in a storage medium mature in the art such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or a power-on erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory and completes the steps of the above method in conjunction with its hardware. To avoid repetition, it is not described in detail here.
[0158] It should be understood that in the embodiment of the present application, the memory may include a read-only memory and a random access memory, and provide instructions and data to the processor.
[0159] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0160] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0161] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0162] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0163] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0164] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0165] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: various media that can store program codes, such as USB flash drives, mobile hard disks, read-only memories (ROM), random access memories (RAM), magnetic disks or optical disks.
[0166] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be covered. Within the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.
Claims
1. A control method, characterized in that: include: It is detected that the vehicle exits the intelligent driving state; When it is determined according to the data collected by the sensor that the vehicle exits the intelligent driving state due to a driver's misoperation, controlling a first warning device in the cockpit to warn the driver; or, When it is determined according to the data collected by the sensor that the driver has caused the vehicle to exit the intelligent driving state due to normal operation, the first prompting device in the cockpit is controlled to prompt that the vehicle has exited the intelligent driving state.
2. The method according to claim 1, characterized in that The determining, based on data collected by the sensor, that the vehicle exits the intelligent driving state due to a driver's misoperation includes: Acquire risk assessment information according to the data collected by the sensor, the risk assessment information including one or more of environmental information around the vehicle, the driving state of the vehicle, and the state of the driver; When the risk assessment information meets a first preset condition, it is determined that the vehicle exits the intelligent driving state due to an erroneous operation by the driver.
3. The method according to claim 2, characterized in that The driving state indicates the position of the vehicle in a first lane, and the environmental information includes information of the first lane. Wherein, when the risk assessment information satisfies a first preset condition, determining that the vehicle exits the intelligent driving state due to a misoperation by the driver includes: When the distance that the position of the vehicle in the first lane deviates from the center line of the first lane is greater than or equal to a first preset distance, or when the time that the vehicle travels across the lane line is greater than or equal to a preset time, it is determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation.
4. The method according to claim 3, characterized in that The first warning device in the control cabin warns the driver, comprising: When the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, controlling a first warning device in the cockpit to warn the driver at a first warning level; Wherein, the method further comprises: When the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a second preset distance, a second warning device in the cockpit is controlled to warn the driver at a second warning level, the second preset distance is greater than the first preset distance, and the second warning level is higher than the first warning level.
5. The method according to claim 3 or 4, characterized in that: Before determining that the vehicle exits the intelligent driving state due to a misoperation by the driver, the method further includes: The first preset distance is determined according to the historical driving habits of the driver.
6. The method according to claim 2, characterized in that The driving state of the vehicle includes the curvature of the predicted trajectory of the vehicle, and the environmental information includes the curvature of the first curve where the vehicle is located. Wherein, when the risk assessment information satisfies a first preset condition, determining that the vehicle exits the intelligent driving state due to a misoperation by the driver includes: When the curvature of the predicted trajectory does not match the curvature of the first curve, it is determined that the vehicle exits the intelligent driving state due to an erroneous operation by the driver.
7. The method according to claim 2, characterized in that When the risk assessment information satisfies a first preset condition, determining that the vehicle exits the intelligent driving state due to a misoperation by the driver includes: When the driver's status indicates that the driver is in a distracted state, a fatigued state, or the driver has performed one or more of dangerous actions, it is determined that the vehicle exits the intelligent driving state due to a misoperation by the driver.
8. The method according to any one of claims 1 to 7, characterized in that The first warning device in the control cabin warns the driver, comprising: When it is determined according to the data collected by the sensor that the driver is not in the ring, controlling the first warning device to issue a hands-off warning to the driver at a third warning level within a first time period; Wherein, the method further comprises: If it is detected that the driver is continuously out of the ring during the first time period, at the end of the first time period, the first warning device is controlled to issue a hands-off warning to the driver at a fourth warning level, where the fourth warning level is higher than the third warning level.
9. A control device, characterized in that: It includes a detection unit, a determination unit and a control unit, wherein: The detection unit is used to detect that the vehicle exits the intelligent driving state; The control unit is configured to control a first warning device in the cockpit to warn the driver when the determination unit determines, based on data collected by the sensor, that the vehicle exits the intelligent driving state due to a driver's misoperation; or When it is determined according to the data collected by the sensor that the driver has caused the vehicle to exit the intelligent driving state due to normal operation, the first prompting device in the cockpit is controlled to prompt that the vehicle has exited the intelligent driving state.
10. The device according to claim 9, characterized in that The device further comprises an acquisition unit, The acquisition unit is used to acquire risk assessment information according to the data collected by the sensor, wherein the risk assessment information includes one or more of the environmental information around the vehicle, the driving state of the vehicle, and the state of the driver; The determination unit is specifically used to: when the risk assessment information meets a first preset condition, determine that the vehicle exits the intelligent driving state due to an erroneous operation by the driver.
11. The device according to claim 10, characterized in that The driving state indicates the position of the vehicle in a first lane, and the environmental information includes information of the first lane. The determining unit is specifically configured to: When the distance that the position of the vehicle in the first lane deviates from the center line of the first lane is greater than or equal to a first preset distance, or when the time that the vehicle travels across the lane line is greater than or equal to a preset time, it is determined that the driver caused the vehicle to exit the intelligent driving state due to misoperation.
12. The device according to claim 11, characterized in that The control unit is specifically used for: When the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a first preset distance, controlling a first warning device in the cockpit to warn the driver at a first warning level; When the position of the vehicle in the first lane deviates from the center line of the first lane by a distance greater than or equal to a second preset distance, a second warning device in the cockpit is controlled to warn the driver at a second warning level, the second preset distance is greater than the first preset distance, and the second warning level is higher than the first warning level.
13. The device according to claim 11 or 12, characterized in that The determining unit is further configured to determine the first preset distance according to the historical driving habits of the driver.
14. The device according to claim 10, characterized in that The driving state of the vehicle includes the curvature of the predicted trajectory of the vehicle, and the environmental information includes the curvature of the first curve where the vehicle is located. The determining unit is specifically configured to: When the curvature of the predicted trajectory does not match the curvature of the first curve, it is determined that the vehicle exits the intelligent driving state due to an erroneous operation by the driver.
15. The device according to claim 10, characterized in that The determining unit is specifically configured to: When the driver's status indicates that the driver is in a distracted state, a fatigued state, or the driver has performed one or more of dangerous actions, it is determined that the vehicle exits the intelligent driving state due to a misoperation by the driver.
16. The device according to any one of claims 9 to 15, characterized in that The control unit is specifically used for: When it is determined according to the data collected by the sensor that the driver is not in the ring, controlling the first warning device to issue a hands-off warning to the driver at a third warning level within a first time period; If it is detected that the driver is continuously out of the ring during the first time period, at the end of the first time period, the first warning device is controlled to issue a hands-off warning to the driver at a fourth warning level, where the fourth warning level is higher than the third warning level.
17. A control device, characterized in that: include: Memory for storing computer programs; A processor, configured to execute the computer program stored in the memory, so that the apparatus performs the method according to any one of claims 1 to 8.
18. A control system, characterized in that: The control system comprises a computing platform and an alarm device, wherein the computing platform comprises a control device as described in any one of claims 9-17.
19. A vehicle, characterized in that: Comprising the apparatus according to any one of claims 9 to 17, or comprising the system according to claim 18.
20. A computer-readable storage medium, characterized in that: Instructions are stored thereon, and when the instructions are executed by a processor, the processor implements the method according to any one of claims 1 to 8.
21. A computer program product, characterized in that The computer program product comprises a computer program code, and when the computer program code is run on a computer, the computer is caused to implement the method according to any one of claims 1 to 8.
22. A chip, characterized in that: The chip comprises a circuit for executing the method according to any one of claims 1 to 8.
Citation Information
Cited By
Control method and device and vehicle
CN120534182A
Scene-awareness-oriented acoustic control and multi-mode prompting method in intelligent cabin and related system
CN121650690A
Control method and apparatus, and vehicle
WO2026040963A1
Control method and apparatus, and vehicle
WO2026158629A1
Interaction method and apparatus, and vehicle
WO2026193811A1
