Method, device and equipment for prompting driving, vehicle and medium

Abstract

The invention relates to a driving prompting method, device and equipment, a vehicle and a medium. The method comprises the following steps: acquiring environment information related to a driving environment of a vehicle in response to the condition that the parking time of the vehicle is greater than a preset time threshold value; the method also includes determining whether the environmental information satisfies a preset environmental condition. In addition, the method further comprises the step of prompting a driver of the vehicle to drive the vehicle by controlling an engine of the vehicle to idle in response to the situation that the environment information meets the preset environment condition. Through the mode, the driving environment around the vehicle is detected after the driver stops for a certain time, and when the driving environment meets the driving requirements such as safety, the driver is prompted to drive in time in an engine idling mode, so that the situation that the driver does not drive the vehicle in time due to factors such as distraction is avoided, and the driving safety is improved. The driving order of the vehicle in the road scene is ensured, and the safety of the vehicle in the driving process is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure generally relate to the field of intelligent driving, and specifically relate to a method, device, equipment, vehicle, and medium for prompting driving. Background Art

[0002] As an integrated control system for multiple active safety functions of the vehicle, the driving assistance system collects environmental data around the vehicle through sensors such as millimeter-wave radars, lidars, and cameras installed in different locations on the vehicle, and uses the environmental data to identify objects in the surrounding environment such as vehicles, pedestrians, and traffic signs.

[0003] Based on the recognition results of different objects in the surrounding environment, the driving assistance system can control and adjust the real-time driving strategy of the vehicle during driving, thereby reducing the driver's driving burden and improving the driver's comfort and safety during driving. Therefore, the driving assistance system plays an important role in the vehicle driving process. Summary of the invention

[0004] The embodiments of the present disclosure provide a method, device, equipment, vehicle and medium for prompting driving. In the embodiments of the present disclosure, when the driver decelerates and brakes the vehicle during driving, the parking time of the vehicle from the time of parking to the current time point is obtained, and it is determined whether the parking time reaches the predetermined time threshold. Then, if the parking time of the vehicle reaches the predetermined time threshold, environmental information used to describe the driving environment of the vehicle is further obtained, such as whether there is a traffic light, whether there are pedestrians in front, etc., and it is determined whether the environmental information meets the preset environmental conditions corresponding to the safe driving requirements. In addition, if the environmental information of the vehicle meets the preset environmental conditions, the engine is controlled to idle at a certain speed, and the driver is prompted to drive the vehicle in time through the sound of the engine idling. In this way, it is avoided that the driver fails to drive the vehicle in time due to distraction and other factors and thus misses the appropriate driving opportunity, further avoids the interference that the driver may cause to other vehicles during driving, ensures the driving order of the vehicle in the road scene, and improves the safety of the vehicle during driving.

[0005] In a first aspect of the present disclosure, a method for prompting driving is provided. The method includes acquiring environmental information related to the driving environment of the vehicle in response to a parking time of the vehicle being greater than a predetermined time threshold. The method also includes determining whether the environmental information satisfies a preset environmental condition. In addition, the method also includes prompting the driver of the vehicle to drive the vehicle by controlling the engine of the vehicle to idle in response to the environmental information satisfying the preset environmental condition.

[0006] In a second aspect of the present disclosure, a device for prompting driving is provided. The device includes an environmental information acquisition module, which is configured to acquire environmental information related to the driving environment of the vehicle in response to the parking time of the vehicle being greater than a predetermined time threshold. The device also includes an environmental condition determination module, which is configured to determine whether the environmental information meets a preset environmental condition. In addition, the device also includes a driving prompt module, which is configured to prompt the driver of the vehicle to drive the vehicle by controlling the engine of the vehicle to idle in response to the environmental information meeting the preset environmental condition.

[0007] In a third aspect of the present disclosure, an electronic device is provided. The electronic device includes one or more processors; and a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement the method provided according to the first aspect of the present disclosure.

[0008] In a fourth aspect of the present disclosure, a vehicle is provided, comprising an engine and the electronic device provided in the third aspect of the present disclosure.

[0009] In a fifth aspect of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer-executable instructions, wherein the computer-executable instructions are executed by a processor to implement the method provided according to the first aspect of the present disclosure.

[0010] It should be understood that the contents described in the summary of the invention are not intended to limit the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0011] The above and other features, advantages and aspects of the embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0012] Figure 1A A schematic diagram illustrating an example environment in which certain embodiments of the present disclosure may be implemented;

[0013] Figure 1B A schematic diagram illustrating another example environment in which certain embodiments of the present disclosure may be implemented;

[0014] Figure 2 A flowchart showing a method of prompt driving according to certain embodiments of the present disclosure;

[0015] Figure 3A flow chart showing a method of determining speed and controlling engine idling according to certain embodiments of the present disclosure;

[0016] Figure 4A A flowchart showing a method for entering a driving state based on a driver's driving state according to certain embodiments of the present disclosure;

[0017] Figure 4B A flowchart showing another method of entering a driving state based on a driver's driving state according to certain embodiments of the present disclosure;

[0018] Figure 5 A flowchart showing a method of entering a driving state according to certain embodiments of the present disclosure;

[0019] Figure 6 A schematic diagram showing a process of entering a driving state according to some embodiments of the present disclosure;

[0020] Figure 7 A block diagram showing an apparatus for prompting driving according to certain embodiments of the present disclosure; and

[0021] Figure 8 A block diagram of an electronic device illustrating certain embodiments of the present disclosure is shown.

[0022] Throughout the drawings, the same or similar reference numbers denote the same or similar elements. DETAILED DESCRIPTION

[0023] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0024] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The terms "first", "second", etc. may refer to different or the same objects. Other explicit and implicit definitions may also be included below.

[0025] For driving assistance systems, such as the Advanced Driving Assistance System (ADAS), since the system has limited perception of the vehicle's surrounding environment, it is necessary to ensure that the driver is always in the driving state during the vehicle's driving. After the vehicle slows down and stops, the driver is allowed to be distracted by doing things that are not related to driving. However, when the factors that cause the vehicle to slow down and stop disappear, the vehicle needs to return to the driving state in time, but the driver often fails to return to the driving state in time due to distraction, which may cause the driver to miss the opportunity to drive or cause the vehicle to collide with other vehicles or pedestrians, which not only interferes with traffic order but also poses certain safety hazards.

[0026] Traditionally, a vehicle's adaptive cruise function is provided with a start button. When the vehicle has been parked for a certain period of time and needs to enter the driving state again, the driver only needs to press the start button, and the vehicle can confirm that the driver has returned to the driving state, so the vehicle can continue to return to the driving state. However, if the driver fails to press the start button in time after parking because of distraction or actions unrelated to driving, it will still cause delays, causing the driver to miss the opportunity to drive or cause a safety accident. Based on this, the traditional solution can only ensure that the driver is in the driving state when the vehicle enters the driving state again, and cannot allow the driver to return to the driving state in time after the vehicle slows down and stops. Therefore, this traditional solution still has the possibility of interfering with traffic order and certain safety hazards.

[0027] To this end, a method for prompting driving is provided in an embodiment of the present disclosure. When the driver decelerates and brakes the vehicle during driving, the parking time of the vehicle from the time of parking to the current time point is obtained, and it is determined whether the parking time reaches a predetermined time threshold. Then, if the parking time of the vehicle reaches the predetermined time threshold, environmental information used to describe the driving environment of the vehicle is further obtained, such as whether there is a traffic light, whether there are pedestrians in front, etc., and it is determined whether the environmental information meets the preset environmental conditions corresponding to the safe driving requirements. In addition, if the environmental information of the vehicle meets the preset environmental conditions, the engine is controlled to idle at a certain speed, and the driver is prompted to drive the vehicle in time through the sound of the engine idling. In this way, the driver is prevented from missing the appropriate driving opportunity due to factors such as distraction and not driving the vehicle in time, and further avoids the interference that the driver may cause to other vehicles during driving, ensures the driving order of the vehicle in the road scene, and improves the safety of the vehicle during driving.

[0028] Figure 1A 1 is a schematic diagram of an example environment 100A in which certain embodiments of the present disclosure may be implemented. Figure 1AAs shown, in the example environment 100A (which may be referred to as a driving environment), the left lane 102-1 of the road is a reverse lane, the right lane 102-2 is a forward lane, and there are a plurality of stationary objects on both sides of the road, such as a plurality of trees 106, road fences (not shown), traffic signs (not shown), and street lights (not shown), etc. At the current time point, a vehicle 108 is at a position 104-1 in the right lane 102-2, and there is a pedestrian 110 in front of the vehicle 108, and the pedestrian 110 is crossing the road.

[0029] Continue to refer Figure 1A The vehicle 108 is provided with a driving assistance system 112. The radar 114 and the visual sensor (e.g., the camera 116) in the driving assistance system 112 collect information about the example environment 100A to obtain environmental information, such as whether there is a traffic light in the example environment 100A, whether there are obstacles or pedestrians in front of the vehicle 108, whether there are other vehicles coming behind the vehicle 108, and other environmental information, and send the environmental information to the electronic device 118. When the parking time of the vehicle 108 reaches a preset time threshold, the electronic device 118 receives the environmental information and determines whether the environmental information meets the preset environmental conditions to determine whether the example environment 100A at this time is a safe driving environment.

[0030] Continue to refer Figure 1A , the electronic device 118 can determine from the environmental information of the example environment 100A that there is a pedestrian 110 in front of the vehicle 108, so the electronic device 118 determines that the environmental information at this time does not meet the environmental condition. At this time, the electronic device 118 controls the braking system 120 of the vehicle 108 to continue to keep the vehicle 108 in a parked state, without instructing the engine 122 of the vehicle 108.

[0031] Figure 1B 1 is a schematic diagram of another example environment 100B in which certain embodiments of the present disclosure may be implemented. Figure 1A as well as Figure 1B As shown, when pedestrians Figure 1A When the pedestrian 110 continues to walk from the right lane 102-2 in the vehicle 108 to the left lane 102-1, the electronic device 118 can determine from the real-time collected environmental information that there is no longer a pedestrian 110 in the area in front of the vehicle 108, so the electronic device 118 determines that the environmental information at this time meets the environmental conditions. At this time, the electronic device 118 controls the braking system 120 of the vehicle 108 to continue to keep the vehicle 108 parked, and controls the engine 122 to idle at a certain speed to prompt the driver to drive in time. When the driver enters the driving state, the vehicle 108 can be controlled to enter the driving state, so as to pass the position 104-2 of the right lane 102-2. In some embodiments, the speed of the engine 122 can be set according to different levels of urgency in the driving environment.

[0032] In the present disclosure, when the driver decelerates and brakes the vehicle during driving, the parking time of the vehicle from the time of parking to the current time point is obtained, and it is determined whether the parking time reaches the predetermined time threshold. Then, if the parking time of the vehicle reaches the predetermined time threshold, environmental information used to describe the driving environment of the vehicle is further obtained, such as whether there is a traffic light, whether there are pedestrians in front, etc., and it is determined whether the environmental information meets the preset environmental conditions corresponding to the safe driving requirements. In addition, if the environmental information of the vehicle meets the preset environmental conditions, the engine is controlled to idle at a certain speed, and the driver is prompted to drive the vehicle in time through the sound of the engine idling. In this way, the driver is prevented from missing the appropriate driving opportunity due to factors such as distraction and the like. It further avoids the interference that the driver may cause to other vehicles during driving, ensures the driving order of vehicles in road scenes, and improves the safety of vehicles during driving.

[0033] It should be understood that the architecture and functions in the example environments 100A and 100B are described for exemplary purposes only, and do not imply any limitation on the scope of the present disclosure. The embodiments of the present disclosure may also be applied to other environments with different structures and / or functions.

[0034] The following will combine Figures 2 to 8 The process according to the embodiment of the present disclosure is described in detail. For ease of understanding, the specific data mentioned in the following description are exemplary and are not intended to limit the scope of protection of the present disclosure. It is understood that the embodiments described below may also include additional actions not shown and / or the actions shown may be omitted, and the scope of the present disclosure is not limited in this respect.

[0035] Figure 2 200 is a flowchart showing a method 200 for prompting driving according to some embodiments of the present disclosure. For example, the method 200 may be Figure 1AThe electronic device 118 shown in is executed. In box 202, it is determined whether the parking time of the vehicle 108 is greater than a predetermined time threshold. In some embodiments, when the vehicle 108 decelerates and stops, the parking time of the vehicle 108 from parking to the current time point can be obtained, and it is determined whether the parking time is greater than a preset time threshold. Alternatively or additionally, when the engine of the vehicle 108 no longer provides power to the vehicle 108 or the clutch of the vehicle 108 no longer intervenes, the parking time is obtained based on the time point and the current time point, and it is determined whether the parking time is greater than the preset time threshold. In some embodiments, the preset time threshold can be set according to the actual scene needs, for example, set to 3 seconds. Alternatively, for scenes with large traffic volume, the time threshold can be lowered, for example, set to 2.5 seconds, and for scenes with small traffic volume, the time threshold can be increased, for example, set to 3.5 seconds.

[0036] At block 204 , if the parking time of the vehicle 108 is greater than a predetermined time threshold, environmental information related to the driving environment of the vehicle 108 is obtained. In some embodiments, the driving environment of the vehicle 108 refers to the surrounding environment of the vehicle 108 , such as Figure 1A Example scenario 100A or Figure 1B In the example scene 100B in the example, the environmental information related to the driving environment refers to the specific information used to describe different objects in the driving environment, such as traffic lights, pedestrians, non-motor vehicles, vehicles, etc. In some embodiments, the camera in front of the vehicle 108 collects the scene image in front, obtains the scene image and analyzes it to determine whether there are pedestrians in front. In some embodiments, the surrounding environment is detected by multiple radars in different directions of the vehicle 108 to determine whether there are vehicles or other objects in the surrounding environment.

[0037] In box 206, it is determined whether the environmental information satisfies the preset environmental conditions. In some embodiments, the preset environmental conditions refer to the scene conditions that the environmental information needs to meet in order to ensure the driving safety of the vehicle 108. For example, when the environmental information is a traffic light, the environmental information needs to meet the condition that the traffic light is displayed as a green light. When the environmental information is a pedestrian, the environmental information needs to meet the condition that the pedestrian is not in the front area of ​​the vehicle 108. When the environmental information is a front crossing vehicle, the environmental information needs to meet the condition that the front crossing vehicle and the vehicle 108 do not intersect.

[0038] In box 208, if the environmental information meets the preset environmental conditions, the engine of the vehicle 108 is controlled to idle to prompt the driver of the vehicle 108 to drive the vehicle 108. In some embodiments, when it is detected that the environmental information meets the preset environmental conditions, the vehicle 108 meets the driving conditions, so the driver is prompted to return to the driving state in time and drive the vehicle 108 by controlling the engine to idle. In the process of engine idling, the clutch of the vehicle 108 is not involved, so the engine only provides the driver with idling sound, but does not provide power for the vehicle. The clutch will only intervene when the vehicle 108 can enter the driving state.

[0039] In some embodiments, the engine speed can be set based on the actual driving environment. For example, in more urgent scenarios such as green lights, a higher speed can be set to increase the urgency of prompting the driver. In general driving scenarios where there are no obstacles ahead and few vehicles around, a lower speed can be set to prompt the driver in a relatively mild manner. In some embodiments, the length of time the engine idles can also be controlled based on environmental information. For example, in more urgent scenarios such as green lights, the engine idle time can be increased to increase the degree of prompting the driver. In some embodiments, the number and frequency of engine idling can also be set. For example, in more urgent scenarios such as green lights, the number and frequency of engine idling can be increased.

[0040] In some embodiments, when the environmental information meets the environmental conditions, the driver can be prompted to drive the vehicle 108 in time through the speaker of the vehicle 108. However, compared with the method of reminding the driver by idling the engine, since the prompt sound output by the speaker of the vehicle 108 is often more, the driver may misunderstand the meaning of the prompt sound or confuse different prompt sounds. In addition, prompting the driver to return to the driving state is a basic safety function for the driving assistance system 112 of the vehicle 108. The method of prompting through the speaker will also require the satisfaction of corresponding safety rules, thereby increasing the cost of prompting the driver. It can be understood that the method of prompting the driver by idling the engine can avoid the driver from being confused by the prompt sound, and the corresponding safety rules can be easily satisfied through the engine control system, thereby improving the safety of driving.

[0041] In some embodiments, if the parking time of the vehicle 108 is less than a preset time threshold, the environmental information around the vehicle 108 is obtained, and when the environmental information meets the preset environmental conditions, it is directly determined that the vehicle can enter the driving state, without prompting the driver to return to the driving state by controlling the engine to idle. It is understandable that since the parking time of the vehicle 108 is very short, it can be assumed that the driver is still in the driving state at this time, so there is no need to prompt the driver by idling the engine, thereby avoiding excessive prompting of the driver in road scenes with frequent start and stop such as traffic jams, and improving the driver's driving experience.

[0042] In an embodiment of the present disclosure, after the vehicle is decelerated and braked to a stop during driving, the parking time of the vehicle from the time of parking to the current time point is obtained, and it is determined whether the parking time reaches a predetermined time threshold. Then, if the parking time of the vehicle reaches the predetermined time threshold, environmental information used to describe the driving environment of the vehicle is further obtained, such as whether there is a traffic light, whether there are pedestrians in front, etc., and it is determined whether the environmental information meets the preset environmental conditions corresponding to the safe driving requirements. In addition, if the environmental information of the vehicle meets the preset environmental conditions, the engine is controlled to idle at a certain speed, and the sound of the engine idling is used to prompt the driver to drive the vehicle in time. In this way, the driver is prevented from missing the appropriate driving opportunity due to factors such as distraction and the like, and further avoids the interference that the driver may cause to other vehicles during driving, ensures the driving order of the vehicle in the road scene, and improves the safety of the vehicle during driving.

[0043] In some embodiments, the engine speed can be determined according to environmental information, and then the engine idling can be controlled based on the speed to prompt the driver to return to the driving state. For example, the engine speed is determined according to the urgency of driving in the environmental information. When the urgency of driving is high, the engine speed can be increased, and when the urgency of driving is low, the engine speed can be reduced. It can be understood that controlling the idling speed of the engine according to different environmental information can meet the prompting requirements in different driving scenarios, thereby further improving the prompting effect on the driver, thereby ensuring the driving order of vehicles on the road and improving the safety of vehicle driving.

[0044] In some embodiments, the driving scene is photographed by a camera installed in front of the vehicle to obtain the state of the traffic light in front, and determine whether the traffic light is in the green light state (which can be called the target state). If the traffic light is in the green light state, the driving urgency corresponding to the green light state is determined, and then the corresponding prompt level (which can be called the first prompt level) is determined based on the urgency, and the engine speed is determined according to the prompt level, and the engine idling is controlled based on the speed. It can be understood that the driving urgency in the green light scene is generally higher, so a higher speed can be determined, so as to prompt the driver to return to the driving state in a more urgent and obvious way.

[0045] Alternatively or additionally, multiple cameras or radars arranged around the vehicle can be used to collect moving objects such as vehicles or pedestrians in the surrounding driving scene, determine the position of the moving object and determine whether the position is in the front area of ​​the vehicle (which can be called a preset area). If it is not in the front area, the driving urgency corresponding to the position of the moving object is determined, and then the corresponding prompt level (which can be called a second prompt level) is determined based on the urgency, and the engine speed is determined according to the prompt level and the engine idling is controlled based on the speed. It can be understood that since the driving urgency in this scenario is generally low, a lower speed can be determined to prompt the driver in a relatively mild manner.

[0046] Figure 3 1 is a flow chart showing a method 300 for determining a rotation speed and controlling engine idling according to certain embodiments of the present disclosure. In some embodiments, the engine idling speed may be determined in combination with a variety of road information and the engine idling may be controlled based on the rotation speed. Figure 3 , in box 302, obtain the parking time. Collect the parking time from the time the vehicle stops to the current time point. In box 304, determine whether the parking time is greater than a predetermined time threshold (for example, 3 seconds). If so, execute box 306 to obtain the state of the traffic light in the driving scene, and execute box 308 to obtain the position of the moving object in the driving scene. If not, return to continue to execute box 302 to obtain the parking time. In box 310, determine whether the traffic light is in the green light state and there is no moving object in the area in front of the vehicle. If so, execute box 312 to determine the engine speed. If not, return to execute box 306 to obtain the state of the traffic light in the driving scene, and return to execute box 308 to obtain the position of the moving object in the driving scene. In box 314, the engine idling is controlled by the determined speed to prompt the driver to return to the driving state.

[0047] Figure 4AA flow chart of a method 400 for entering a driving state based on the driving state of a driver in certain embodiments of the present disclosure is shown. In some embodiments, in box 402, environmental information of the vehicle is obtained. In box 404, it is determined whether the environmental information meets the pre-set environmental conditions. If the environmental conditions are met, box 406 is executed to control the engine to idle based on a certain speed, and box 408 is executed to obtain the driver's information. In some embodiments, the driver's information includes information such as the driver's posture, expression, and line of sight. If the environmental conditions are not met, return to execution box 402 to obtain the vehicle's environmental information. In box 410, it is determined whether the driver is in a driving state based on the driver's information. If the driver is in a driving state, box 412 is executed to control the vehicle to enter a driving state. If the driver is not in a driving state, return to execution box 408 to obtain the driver's information. It can be understood that in this embodiment, the vehicle is controlled to enter a driving state only after the driver returns to the driving state, thereby improving the safety of the vehicle during driving.

[0048] In some embodiments, the driving state of the driver includes the driver's control state of the steering wheel of the vehicle. A capacitive signal is collected by a capacitive sensor arranged at the steering wheel of the vehicle, and it is determined whether the driver holds the steering wheel with both hands based on the capacitive signal, and then it is determined whether the driver is in the control state of the steering wheel. If the driver is in the control state of the steering wheel, the vehicle is controlled to enter a driving state. Alternatively or additionally, the driving state of the driver includes the driver's line of sight being in the front area of ​​the vehicle, and the driver's line of sight information is collected by sensors such as cameras in the vehicle, and it is determined whether the driver's line of sight is in the front area of ​​the vehicle based on the implementation information. If the line of sight is in the front area, the vehicle is controlled to enter a driving state.

[0049] Figure 4B A flow chart of another method 400B for entering a driving state based on a driver's driving state according to certain embodiments of the present disclosure is shown. In some embodiments, in box 402, environmental information of the vehicle is obtained. In box 404, it is determined whether the environmental information meets a preset environmental condition. If the environmental condition is met, box 406 is executed to control the engine to idle based on a certain speed, and box 408-1 is executed to obtain a capacitance signal at the steering wheel, and box 408-2 is also executed to obtain the driver's line of sight information. If the environmental condition is not met, return to box 402 to obtain the environmental information of the vehicle.

[0050] Continue to refer Figure 4BIn box 410, it is determined whether the driver is in a state of controlling the steering wheel according to the capacitance signal at the steering wheel and whether the driver's line of sight is in the front area according to the line of sight information. If the driver is in a state of controlling the steering wheel and the driver's line of sight is in the front area, box 412 is executed to control the vehicle to enter a driving state. If at least one of the conditions of the driver being in a state of controlling the steering wheel and the driver's line of sight being in the front area is not satisfied, the execution box 408-1 is returned to obtain the capacitance signal at the steering wheel, and the execution box 408-2 is returned to obtain the driver's line of sight information.

[0051] Figure 5 A flowchart of a method 500 for entering a driving state in certain embodiments of the present disclosure is shown. Figure 5 In box 502, the vehicle is controlled to slow down and stop. In box 504, the vehicle is controlled to keep stopping. In some embodiments, after the vehicle is detected to slow down and stop, the vehicle can be controlled to keep stationary by the vehicle's brake system, such as the brake. In box 506, it is determined whether the vehicle's parking time is greater than a predetermined time threshold (e.g., 3 seconds). If it is greater than the predetermined time threshold, box 508 is executed to continue controlling the vehicle to keep stopping.

[0052] Continue to refer Figure 5 , in box 510, determine whether the environmental information meets the environmental conditions. In some embodiments, the environmental information includes traffic lights, vehicles, pedestrians, non-motor vehicles, road fences, etc. If the state of the traffic lights in the driving environment is green, and there are no other vehicles and pedestrians around the vehicle, it can be determined that the environmental information meets the environmental conditions. If the environmental information meets the environmental conditions, execute box 512 to control the engine to idle at a certain speed to prompt the driver to return to the driving state, and execute box 514 to continue to control the vehicle to keep the brake state. If the environmental information does not meet the environmental conditions, return to execution box 508 and continue to control the vehicle to keep the brake state.

[0053] Continue to refer Figure 5 In box 516, it is determined whether the driver is in a state of controlling the steering wheel. If the driver is in a state of controlling the steering wheel, box 518 is executed to determine whether the driver's line of sight is in front of the vehicle. If the driver is not in a state of controlling the steering wheel, the process returns to box 514 to continue to control the vehicle to remain stationary. Further, if the driver's line of sight is in front of the vehicle, box 522 is executed to request torque from the engine to control the vehicle to enter a driving state. If the driver's line of sight is not in front of the vehicle, the process returns to box 514 to continue to control the vehicle to remain stationary.

[0054] Continue to refer Figure 5In some embodiments, in box 506, it is determined whether the parking time of the vehicle is greater than a predetermined time threshold. If it is less than the predetermined time threshold, box 520 is executed to determine whether the environmental information meets the environmental conditions. If the environmental information meets the environmental conditions, box 522 is executed to request torque from the engine to control the vehicle to enter a driving state. If the environmental information does not meet the environmental conditions, it returns to execution box 504 to control the vehicle to remain in a braked state. It can be understood that if the parking time of the vehicle is less than the predetermined time threshold, it indicates that the driver still expects to be identified as being in a driving state. Therefore, there is no need to control the engine to idle to prompt the driver to return to the driving state, nor is there any need to detect and judge whether the driver is in a driving state. When the environmental information meets the environmental conditions, the vehicle can be directly controlled to enter a driving state.

[0055] Figure 6 FIG. 6 is a schematic diagram showing a process 600 of entering a driving state according to some embodiments of the present disclosure. Figure 6 In some embodiments, the vehicle obtains environmental perception information 608 (which may be referred to as environmental information) through a camera 602, a millimeter wave radar 604, and a laser radar 606, and sends the environmental perception information 608 to a driving assistance system 618. A capacitive sensor 610 is provided in the steering wheel of the vehicle, which is used to collect a capacitive signal 612 and send it to the driving assistance system 618. A driver monitoring system 614 is also provided in the cockpit of the vehicle, which is used to collect driver information 616 and send it to the driving assistance system 618.

[0056] Continue to refer Figure 6 , the driving assistance system 618 determines whether the current driving environment meets the safety condition according to the environmental perception information 608, and determines whether the driver's hands are holding the steering wheel and whether the driver's line of sight is in front of the vehicle according to the capacitance signal 612 and the driver information 616. If at least one of the above conditions is not met, a brake request 620 is sent to the brake system 622 to maintain the brake state of the vehicle through the brake system 622. If the driving assistance system 618 determines that the driving environment meets the safety condition, and there is at least one of the following situations: the driver's hands are not holding the steering wheel and the driver's line of sight is not in front of the vehicle, an idling request 624 is sent to the engine 628, and the driver is prompted to hold the steering wheel and turn his line of sight to the front of the vehicle by idling the engine 628. If the driving assistance system 618 determines that the driving environment meets the safety condition, and the driver's hands are holding the steering wheel and the driver's line of sight is in front of the vehicle, a request 626 for providing power is sent to the engine 628, thereby controlling the vehicle to enter the driving state.

[0057] Figure 7 FIG. 7 is a block diagram of a driving prompting device 700 according to some embodiments of the present disclosure. Figure 7As shown, the device 700 includes an environmental information acquisition module 702, which is configured to acquire environmental information related to the driving environment of the vehicle in response to the parking time of the vehicle being greater than a predetermined time threshold. The device 700 also includes an environmental condition determination module 704, which is configured to determine whether the environmental information meets a preset environmental condition. In addition, the device 700 also includes a driving prompt module 706, which is configured to prompt the driver of the vehicle to drive the vehicle by controlling the engine of the vehicle to idle in response to the environmental information meeting the preset environmental condition.

[0058] In some embodiments, controlling an engine idle of a vehicle includes: a speed determination module configured to determine a speed of the engine based on environmental information; and an engine idle control module configured to control the engine idle based on the determined speed.

[0059] In some embodiments, the environmental information includes a traffic light state for a traffic light obtained by a visual sensor, and the speed determination module is further configured to: in response to the traffic light state being a target state, determine a first prompt level based on the traffic light state; and determine a first speed of the engine based on the first prompt level.

[0060] In some embodiments, the environmental information includes a position of a moving object obtained by at least one of a visual sensor and a radar, and the speed determination module is further configured to: in response to the position of the moving object being outside a preset area in the driving environment, determine a second prompt level based on the position of the moving object; and determine a second speed of the engine based on the second prompt level.

[0061] In some embodiments, the device 700 also includes: an environmental information acquisition module, configured to acquire environmental information in response to the parking time being less than a predetermined time threshold; and a driving state determination module, configured to determine that the vehicle enters a driving state in response to the environmental information satisfying preset environmental conditions.

[0062] In some embodiments, the device 700 also includes: a driving state determination module, configured to determine whether the driver is in a driving state in response to environmental information satisfying preset environmental conditions; and a driving state determination module, configured to determine that the vehicle enters a driving state in response to the driver being in a driving state.

[0063] In some embodiments, the driving state includes the driver's control state of the steering wheel of the vehicle, and the device 700 also includes: a capacitance signal acquisition module, configured to acquire a capacitance signal from a capacitance sensor at the steering wheel; a control state determination module, configured to determine whether the driver is in a control state of the steering wheel based on the capacitance signal; and a driving state determination module, configured to determine that the vehicle enters a driving state in response to the driver being in a control state of the steering wheel.

[0064] In some embodiments, the driving state also includes the driver's line of sight being within a preset front area of ​​the vehicle, and the device 700 also includes: a line of sight information acquisition module, configured to acquire the driver's line of sight information; a line of sight area determination module, configured to determine whether the driver's line of sight is within a preset front area of ​​the vehicle based on the line of sight information; and a driving state determination module, configured to determine that the vehicle enters a driving state in response to the driver's line of sight being within a preset front area of ​​the vehicle.

[0065] In some embodiments, the device 700 also includes: a parking state determination module, configured to determine whether the vehicle enters a parking state from a driving state; and a parking state maintaining module, configured to control the vehicle to maintain a parking state through a braking system in response to the vehicle entering a parking state from a driving state.

[0066] In some embodiments, the predetermined time threshold is 3 seconds.

[0067] It can be understood that the device 700 of the present disclosure can achieve at least one of the many advantages that can be achieved by the method or process described above. For example, the device 700 can obtain the parking time of the vehicle from parking to the current time point, and determine whether the parking time reaches the predetermined time threshold. Then, if the parking time of the vehicle reaches the predetermined time threshold, further obtain environmental information used to describe the driving environment of the vehicle, such as whether there is a traffic light, whether there are pedestrians in front, etc., and determine whether the environmental information meets the preset environmental conditions corresponding to the safe driving requirements. In addition, if the environmental information of the vehicle meets the preset environmental conditions, the engine is controlled to idle at a certain speed, and the driver is prompted to drive the vehicle in time through the sound of the engine idling. In this way, it is avoided that the driver fails to drive the vehicle in time due to distraction and other factors and thus misses the appropriate driving opportunity, further avoids the interference that the driver may cause to other vehicles during driving, ensures the driving order of the vehicle in the road scene, and improves the safety of the vehicle during driving.

[0068] Figure 8 8 is a block diagram of an electronic device 800 according to some embodiments of the present disclosure. Figure 8 As shown, the electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to computer program instructions stored in a read-only memory (ROM) 802 or computer program instructions loaded from a storage unit 808 into a random access memory (RAM) 803. In the RAM 803, various programs and data required for the operation of the electronic device 800 can also be stored. The computing unit 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0069] Multiple components in the electronic device 800 are connected to the I / O interface 805, which may include, for example: an input unit 806, such as a keyboard, a mouse, etc.; an output unit 807, such as various types of displays, speakers, etc.; a storage unit 808, such as a disk, an optical disk, etc.; and a communication unit 809, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 809 allows the electronic device 800 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0070] The computing unit 801 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 801 performs the various methods and processes described above, such as method 200. For example, in some embodiments, the method 200 may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 800 via the ROM 802 and / or the communication unit 809. When the computer program is loaded into the RAM 803 and executed by the computing unit 801, one or more steps of the method 200 described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the method 200 in any other appropriate manner (e.g., by means of firmware).

[0071] The functions described above herein may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip systems (SOCs), load programmable logic devices (CPLDs), and the like.

[0072] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0073] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In addition, although each operation is depicted in a specific order, this should be understood as requiring such operations to be performed in the specific order shown or in a sequential order, or requiring that all illustrated operations should be performed to obtain the desired result. In certain environments, multitasking and parallel processing may be advantageous. Similarly, although several specific implementation details are included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Certain features described in the context of separate embodiments can also be implemented in a single implementation in combination. On the contrary, the various features described in the context of a single implementation can also be implemented in multiple implementations individually or in any suitable sub-combination.

[0074] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the equipment, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each frame in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the frame can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous frames can actually be executed substantially in parallel, and they can also be executed in the opposite order sometimes, depending on the functions involved. It should also be noted that each frame in the block diagram and / or flow chart, and the combination of frames in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or action, or can be implemented with a combination of dedicated hardware and computer instructions.

[0075] Although the subject matter has been described in language specific to structural features and / or methodological logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. On the contrary, the specific features and actions described above are merely example forms of implementing the claims.

Claims

1. A method for prompting driving, comprising: In response to a parking time of the vehicle being greater than a predetermined time threshold, acquiring environmental information related to a driving environment of the vehicle; Determining whether the environmental information meets a preset environmental condition; as well as In response to the environmental information satisfying the preset environmental condition, a driver of the vehicle is prompted to drive the vehicle by controlling an engine of the vehicle to idle.

2. The method of claim 1 , wherein controlling the engine of the vehicle to idle comprises: determining a rotation speed of the engine based on the environmental information; as well as The engine idling is controlled based on the determined speed.

3. The method according to claim 2, wherein the environmental information comprises a signal light state for a traffic light acquired by a visual sensor, and determining the speed of the engine based on the environmental information comprises: In response to the signal light state being a target state, determining a first prompt level based on the signal light state; as well as A first speed of the engine is determined based on the first prompt level.

4. The method according to claim 2, wherein the environmental information comprises a position of a moving object acquired by at least one of a visual sensor and a radar, and determining the speed of the engine based on the environmental information comprises: In response to the position of the moving object being outside a preset area in the driving environment, determining a second prompt level based on the position of the moving object; as well as A second speed of the engine is determined based on the second prompt level.

5. The method according to claim 1, further comprising: In response to the parking time being less than the predetermined time threshold, acquiring the environmental information; as well as In response to the environmental information satisfying the preset environmental condition, it is determined that the vehicle enters a driving state.

6. The method according to claim 1, further comprising: In response to the environmental information satisfying the preset environmental condition, determining whether the driver is in a driving state; as well as In response to the driver being in the driving state, it is determined that the vehicle enters a driving state.

7. The method according to claim 6, wherein the driving state includes the driver's control state of the steering wheel of the vehicle, and the method further comprises: Acquire a capacitance signal from a capacitance sensor at the steering wheel; determining whether the driver is in the control state of the steering wheel based on the capacitance signal; as well as In response to the driver being in the manipulation state of the steering wheel, it is determined that the vehicle enters the driving state.

8. The method according to claim 7, wherein the driving state further comprises the driver's line of sight being located within a preset front area of ​​the vehicle, and the method further comprises: Acquiring the driver's sight line information; Determining whether the driver's line of sight is located within the preset front area of ​​the vehicle based on the line of sight information; as well as In response to the line of sight of the driver being located within the preset front area of ​​the vehicle, it is determined that the vehicle enters the driving state.

9. The method according to any one of claims 5 to 8, further comprising: determining whether the vehicle enters a parking state from the driving state; as well as In response to the vehicle entering the parking state from the driving state, the vehicle is controlled by a braking system to maintain the parking state.

10. The method according to claim 1, wherein the predetermined time threshold is 3 seconds.

11. A driving reminder device, comprising: an environment information acquisition module, configured to acquire environment information related to a driving environment of the vehicle in response to a parking time of the vehicle being greater than a predetermined time threshold; An environmental condition determination module is configured to determine whether the environmental information meets a preset environmental condition; as well as The driving prompt module is configured to prompt the driver of the vehicle to drive the vehicle by controlling the engine of the vehicle to idle in response to the environmental information satisfying the preset environmental condition.

12. An electronic device comprising: at least one processor; as well as A memory coupled to the at least one processor and having instructions stored thereon, the instructions, when executed by the at least one processor, causing the apparatus to perform the method according to any one of claims 1-10.

13. A vehicle comprising: engine; as well as The electronic device according to claim 12.

14. A computer-readable storage medium having computer-executable instructions stored thereon, wherein the computer-executable instructions are executed by a processor to implement the method according to any one of claims 1 to 10.

Images