Intelligent sensing vehicle control method, system and device

Abstract

The invention relates to the technical field of intelligent traffic, and provides an intelligent sensing vehicle control method, system and device. The intelligent sensing vehicle control method comprises the following steps: in response to road condition information acquired by acquisition equipment and / or motion state information of a vehicle, analyzing a current driving working condition of the vehicle; and when the current driving condition triggers the to-be-standardized driving condition, controlling the vehicle to send a prompt corresponding to the to-be-standardized driving condition. The road condition and vehicle condition information is collected in real time through the collecting device, and real-time intelligent sensing and judgment of the whole driving process of the vehicle are achieved; the vehicle is controlled to send out the prompt corresponding to the to-be-standardized driving condition, so that a user can timely and accurately know the triggered to-be-standardized driving condition, and the constraint and standardization of the driving behavior of the user are realized.

Description

Technical Field

[0001] The present invention relates to the field of intelligent transportation technology, and in particular to an intelligent perception transportation vehicle control method, system and device. Background Art

[0002] As the concept of low-carbon and environmentally friendly life becomes more and more popular, people are increasingly favoring the use of bicycles, motorcycles and other means of transportation. However, due to the irregular use of transportation by users, traffic accidents caused by transportation tools occur frequently.

[0003] At present, the penalty for users' irregular use of transportation tools mainly relies on on-site manual work and combined with intersection surveillance cameras. Specifically, for motor vehicles, the intersection surveillance cameras can be used to capture and combine on-site manual work to determine whether the user has irregular behaviors such as running a red light or driving in the wrong direction; for non-motor vehicles, it is necessary for traffic police to manually implement penalty on-site. The current method requires the traffic management department to install surveillance cameras at designated intersections, which cannot analyze the user's driving behavior in real time and comprehensively; on the other hand, the penalty is only a post-event punishment, which cannot achieve the role of regulating the user's use of transportation tools. Summary of the invention

[0004] The present invention provides an intelligent perception vehicle control method, system and device, which can realize real-time perception and judgment of the entire vehicle driving process, and timely and flexibly manage the user's behavior of using the vehicle, so as to encourage the user to use the vehicle in a standardized manner.

[0005] According to one aspect of the present invention, there is provided a method for controlling a vehicle with intelligent perception, comprising: analyzing a current driving condition of the vehicle in response to road condition information and / or motion state information of the vehicle collected by a collection device; when the current driving condition triggers a driving condition to be standardized, controlling the vehicle to issue a reminder corresponding to the driving condition to be standardized.

[0006] In some embodiments, the collection device is loaded on the vehicle.

[0007] In some embodiments, the collection device includes a camera capable of collecting the road condition information and / or a sensor capable of collecting the motion state information.

[0008] In some embodiments, controlling the vehicle to issue a reminder corresponding to the driving condition to be regulated includes: controlling the vehicle to issue a voice reminder and / or a display reminder corresponding to the driving condition to be regulated; and / or controlling the vehicle to issue a vibration reminder.

[0009] In some embodiments, the analysis of the current driving condition of the vehicle includes: judging whether the current driving condition triggers a red light reminder for a driving condition to be regulated based on the traffic light status information and the motion status information in the road condition information; wherein the motion status information includes the position, speed and direction of movement of the vehicle.

[0010] In some embodiments, in any of the following circumstances, the current driving condition is judged as triggering the red light reminder as a driving condition to be regulated: the vehicle enters within a first preset distance range of the stop line of the intersection; the vehicle enters within a second preset distance range of the stop line of the intersection, and the traffic light is red at any time during the process of the vehicle moving to the stop line of the intersection with the current driving intention; the vehicle exceeds the stop line of the intersection, and the traffic light that matches the direction of movement of the vehicle is red; the vehicle enters within a third preset distance range of the stop line of the intersection or the vehicle exceeds the stop line of the intersection, the traffic light that matches the direction of movement of the vehicle turns green, and the vehicle stays for more than a preset time.

[0011] In some embodiments, the traffic light is red at any time during the process of the vehicle moving to the stop line of the intersection with the current driving intention, including: the traffic light is currently red and the speed of the vehicle is not zero; the traffic light will turn red during the process of the vehicle moving to the stop line of the intersection with the current speed.

[0012] In some embodiments, when the vehicle enters the second preset distance range of the stop line of the intersection and the traffic light is red at any time during the process of the vehicle moving to the stop line of the intersection with the current driving intention: the vehicle is controlled to slow down.

[0013] In some embodiments, the analysis of the current driving condition of the vehicle includes: judging whether the current driving condition triggers a driving condition to be regulated for a collision reminder based on obstacle status information and the motion status information in the road condition information; wherein obstacles include pedestrians, surrounding vehicles and roadblock signs.

[0014] In some embodiments, when the obstacle exists within a preset range of the vehicle and the vehicle will collide with the obstacle if it continues to move with the current driving intention, the current driving condition is determined to be a driving condition to be regulated that triggers the collision reminder.

[0015] In some embodiments, the analyzing the current driving condition of the vehicle includes: judging whether the current driving condition triggers a driving condition to be regulated for lane occupation reminder based on lane information in the road condition information and the motion state information.

[0016] In some embodiments, the current driving condition triggers the lane occupation reminder to be regulated driving condition in any of the following situations: the vehicle is driving in the opposite direction on a matching lane; the vehicle is moving forward or in the opposite direction on a non-matching lane; the vehicle is in a non-matching lane and stays there for a preset period of time.

[0017] In some embodiments, when it is determined that the current driving condition triggers the unregulated driving condition for the collision reminder or the unregulated driving condition for the lane occupying reminder: the vehicle is controlled to decelerate to avoid a collision.

[0018] In some embodiments, under different circumstances, the vehicle is controlled to issue standard driving voice reminders and / or standard driving display reminders corresponding to different circumstances.

[0019] In some embodiments, when the current driving condition triggers the driving condition to be regulated, a reminder message corresponding to the driving condition to be regulated is also sent to a communication device authorized for interaction among the communication devices around the vehicle; wherein the communication device includes a mobile communication device and a vehicle-mounted communication device, and the reminder message includes the position information and / or motion information of the vehicle relative to the communication device.

[0020] In some embodiments, the vehicle is a shared vehicle; when the current driving condition triggers the driving condition to be regulated, the irregular behavior represented by the current driving condition is bound and stored with the corresponding user account; before responding to the road condition information and motion status information collected by the collection device loaded on the vehicle, it also includes: responding to the unlocking request of the vehicle, obtaining the historical irregular behavior of the current user account that issued the unlocking request; during the unlocking process of the vehicle, obtaining corresponding control instructions based on the historical irregular behavior of the current user account.

[0021] In some embodiments, when the current driving condition triggers the driving condition to be regulated, the violation information represented by the current driving condition is also uploaded to the traffic management system.

[0022] In some embodiments, the control method further includes: in response to a dialogue instruction, controlling the vehicle to enter a dialogue mode; in response to an inquiry instruction for driving-related information, controlling the vehicle to feedback a corresponding voice answer and / or display answer.

[0023] According to another aspect of the present invention, there is provided an intelligent-perception vehicle control system for implementing the intelligent-perception vehicle control method described in any of the above-mentioned embodiments, wherein the intelligent-perception vehicle control system comprises: a working condition analysis module, configured to: analyze the current driving condition of the vehicle in response to the road condition information and / or motion state information collected by the collection device; and a reminder control module, configured to: control the vehicle to issue a reminder corresponding to the driving condition to be standardized when the current driving condition triggers the driving condition to be standardized.

[0024] According to another aspect of the present invention, there is provided an electronic device, comprising: a processor; a memory, wherein the memory stores executable instructions; wherein when the executable instructions are executed by the processor, the intelligent perception vehicle control method described in any of the above embodiments is implemented.

[0025] According to another aspect of the present invention, a computer-readable storage medium is provided for storing a program, wherein when the program is executed by a processor, the intelligent perception vehicle control method described in any of the above embodiments is implemented.

[0026] According to another aspect of the present invention, a computer program product is provided, comprising a computer program, wherein when the computer program is executed by a processor, the intelligent perception vehicle control method described in any of the above embodiments is implemented.

[0027] The beneficial effects of the present invention compared with the prior art include at least:

[0028] The intelligent perception vehicle control scheme of the present invention collects road condition information and vehicle motion status information in real time through collection equipment, thereby realizing real-time intelligent perception and judgment of the entire vehicle driving process; when the current driving condition triggers the driving condition to be standardized, the vehicle is controlled to issue a reminder corresponding to the driving condition to be standardized, so that the user can accurately know the triggered driving condition to be standardized, thereby timely and accurately managing the user's behavior in using the vehicle, prompting the user to use the vehicle in a standardized manner, so as to ensure orderly and safe traffic.

[0029] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] The accompanying drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present invention, and together with the specification are used to explain the principles of the present invention. Obviously, the accompanying drawings described below are only some embodiments of the present invention, and for those of ordinary skill in the art, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0031] Figure 1 A schematic diagram showing the steps of the intelligent sensing vehicle control method in an embodiment of the present invention;

[0032] Figure 2 A schematic diagram showing the steps of analyzing the current driving condition of a vehicle in an embodiment of the present invention;

[0033] Figure 3 A schematic diagram showing the steps of another intelligent sensing vehicle control method in an embodiment of the present invention;

[0034] Figure 4 A schematic diagram showing a module of a vehicle control system with intelligent perception in an embodiment of the present invention;

[0035] Figure 5 A schematic structural diagram of an electronic device in an embodiment of the present invention is shown. DETAILED DESCRIPTION

[0036] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the embodiments described herein. Instead, these embodiments are provided to make the present invention more comprehensive and complete and to fully convey the concepts of the example embodiments to those skilled in the art.

[0037] The accompanying drawings are only schematic illustrations of the present invention and are not necessarily drawn to scale. The same reference numerals in the figures represent the same or similar parts, and their repeated description will be omitted. Some of the block diagrams shown in the accompanying drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities can be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0038] The words "first", "second" and similar terms used in the specific description do not indicate any order, quantity or importance, but are only used to distinguish different components. In addition, the processes shown in the drawings are only exemplary and do not necessarily include all the steps. For example, some steps can be decomposed, some steps can be combined or partially combined, and the actual execution order may change according to the actual situation.

[0039] It should be noted that, in the absence of conflict, the embodiments of the present invention and features in different embodiments may be combined with each other.

[0040] The intelligent sensing vehicle control scheme of the present invention is applicable to private vehicles and shared vehicles. Among them, shared vehicles may include any existing or future shared vehicles such as shared bicycles and shared electric motorcycles. The implementation subject of the vehicle control scheme of the present invention may be a controller mounted on the vehicle, or a remote controller, cloud controller, or other controller that is communicatively connected to the vehicle; the implementation subject can be connected to the acquisition device and the controlled device to receive the information collected by the acquisition device and realize the control of the controlled device; the acquisition device and / or the controlled device can be mounted on the vehicle, or be communicatively connected to the vehicle. The implementation subject can also be communicatively connected to the traffic management system, surrounding communication equipment, etc. to realize traffic collaborative management.

[0041] Figure 1 The main steps of the intelligent sensing vehicle control method are shown in FIG. Figure 1 As shown, the intelligent sensing vehicle control method provided by the embodiment of the present invention includes:

[0042] S130, analyzing the current driving condition of the vehicle in response to the road condition information and / or motion state information collected by the collection device.

[0043] The collection device can be loaded on a vehicle, or can be independent of the vehicle and connected to the vehicle for communication.

[0044] The collection equipment includes a camera capable of collecting road condition information and / or a sensor capable of collecting motion state information.

[0045] The road condition information is mainly collected by the camera. The camera may include a front camera; through the front camera, the complex road conditions in front of the vehicle are perceived in real time. In some embodiments, visual sensors such as the front camera and radar sensors can also be combined to realize the collection of road condition information around the vehicle. The road condition information may include the status information of facilities on the road (such as traffic lights, lanes, roadblock signs, etc.) and the status information of pedestrians and vehicles on the road.

[0046] The motion state information may include the location information, speed information, motion direction information, etc. of the vehicle. The motion state information is mainly collected by sensors that can sense the motion state of the vehicle, such as the location, speed, and motion direction; the sensors here may include multiple sensors such as positioning sensors, speed sensors, steering sensors, acceleration sensors, etc., or may be a sensor integrating multiple functions.

[0047] Based on the road condition information and / or motion status information, the current driving condition of the vehicle can be analyzed, for example, whether the vehicle is in a matching lane, whether it follows traffic lights, whether there is a risk of collision, etc.

[0048] S140, when the current driving condition triggers the driving condition to be standardized, controlling the vehicle to issue a reminder corresponding to the driving condition to be standardized.

[0049] The driving conditions to be standardized can be set as needed, for example, including the driving conditions to be standardized for red light reminder, the driving conditions to be standardized for collision reminder, the driving conditions to be standardized for lane occupation reminder, and so on.

[0050] Among them, controlling the vehicle to issue a reminder corresponding to the driving condition to be regulated includes: controlling the vehicle to issue a voice reminder and / or a display reminder corresponding to the driving condition to be regulated; and / or controlling the vehicle to issue a vibration reminder.

[0051] The voice reminder can be issued through the speaker of the vehicle, and the speaker can be installed in any suitable position, such as on the handlebar. The display reminder can be issued through the display screen of the vehicle, and the display screen can be installed in a suitable position such as the middle position of the handlebar. The voice reminder and the display reminder can be issued one by one or simultaneously, so that the user can know the currently triggered driving condition to be regulated through hearing / vision. The voice reminder / display reminder corresponding to the driving condition to be regulated, for example: when the current driving condition triggers the driving condition to be regulated of the red light reminder, a voice reminder / display reminder containing the relevant keywords / key patterns of "red light" is issued; when the current driving condition triggers the driving condition to be regulated of the collision reminder, a voice reminder / display reminder containing the relevant keywords / key patterns of "collision" is issued; when the current driving condition triggers the driving condition to be regulated of the lane occupation reminder, a voice reminder / display reminder containing the relevant keywords / key patterns of "lane occupation" is issued.

[0052] The vibration reminder can be issued through the user contact part of the vehicle. The user contact part may include a suitable part such as a seat cushion, a handlebar, etc. The vibration reminder of the seat cushion can be a massage design. The amplitude of the vibration can be set as needed to ensure that the user receives the vibration reminder in time while avoiding affecting the user's normal control of the vehicle.

[0053] Therefore, the intelligent perception vehicle control method of the present invention collects road condition information and vehicle motion state information in real time through collection equipment, thereby realizing real-time intelligent perception and judgment of the entire vehicle driving process; when the current driving condition triggers the driving condition to be standardized, the vehicle is controlled to issue a reminder corresponding to the driving condition to be standardized, for example, a vibration reminder of the user's contact part is used to give the user a direct and timely reminder perception, and a voice reminder and / or display reminder is used to enable the user to accurately know the triggered driving condition to be standardized, etc., thereby timely and accurately managing the user's behavior in using the vehicle, prompting the user to use the vehicle in a standardized manner, so as to ensure orderly and safe traffic.

[0054] Figure 2 The main steps of analyzing the current driving condition of a vehicle are shown. Figure 1 and Figure 2 As shown, step S130 "analyzing the current driving condition of the vehicle in response to the road condition information and / or motion state information collected by the collection device" may include one or more steps of S130a, S130b, and S130c.

[0055] S130a, judging whether the current driving condition triggers a red light reminder driving condition to be regulated based on the traffic light status information and the motion status information in the road condition information.

[0056] Traffic light status information, including the current status of the traffic light and the change status. Based on the traffic light status information and the vehicle's motion status information, it can be determined whether the vehicle's current driving condition triggers a red light reminder for a driving condition that needs to be regulated, such as approaching an intersection, possibly running a red light, or having already run a red light.

[0057] Specifically, in some embodiments, in the following four situations, it can be determined that the current driving condition triggers the red light reminder and is a driving condition to be regulated.

[0058] The first driving condition to be regulated that triggers a red light reminder is when a vehicle enters a first preset distance range from the stop line of an intersection.

[0059] The first preset distance range can be set as needed, for example, 30m, but not limited thereto. When the vehicle enters the first preset distance range of the stop line of the intersection (for example, the vehicle is 30m away from the vehicle), it indicates that the vehicle is approaching the intersection. At this time, the vehicle is controlled to issue a standardized driving voice reminder and / or a standardized driving display reminder corresponding to the first type of driving condition to be regulated that triggers the red light reminder (for example, a voice reminder of "approaching the stop line of the intersection, please pay attention to the status of the traffic lights and real-time road conditions", but not limited thereto), and the vehicle is controlled to issue a vibration reminder through the user's contact part; in this way, it serves to remind the user to avoid possible red light running.

[0060] The second driving condition to be regulated that triggers a red light reminder is that the vehicle enters a second preset distance range of the stop line of the intersection, and the traffic light is red at any time during the process of the vehicle moving to the stop line of the intersection with the current driving intention. The second preset distance range can be set as needed, for example, less than or equal to the first preset distance range, but is not limited thereto.

[0061] Specifically, the traffic light is red at any time when the vehicle moves to the stop line of the intersection with the current driving intention, including: the traffic light is currently red and the speed of the vehicle is not zero; the traffic light will turn red when the vehicle moves to the stop line of the intersection with the current speed. Among them, if the speed of the vehicle is zero, it is judged that the vehicle does not have the current driving intention, that is, the vehicle does not trigger the red light reminder of the unregulated driving condition, and no reminder is required.

[0062] For example, when the distance between the vehicle and the stop line of the intersection is greater than 0m and less than 30m: if it is detected that the traffic light ahead is red, or the traffic light ahead is always red while the vehicle is moving at the current speed to the stop line of the intersection, the vehicle is controlled to issue a voice reminder of "The light ahead is red, please slow down" or similar expressions, and the seat or handlebars of the vehicle are controlled to vibrate slightly to give a reminder; if it is detected that the traffic light ahead is in the state of counting down from green to red, the vehicle can be controlled to issue a voice reminder of "The light ahead turns from green to red, please slow down" or similar expressions, and the seat or handlebars of the vehicle are controlled to vibrate slightly to give a reminder; in this way, it can serve to remind users to avoid impending red light running.

[0063] Furthermore, in the case of the second driving condition that triggers a red light reminder and awaits standardization, in addition to controlling the vehicle to issue a vibration reminder and a standardized driving voice reminder and / or a standardized driving display reminder corresponding to the second driving condition that triggers a red light reminder and awaits standardization, the vehicle can also be controlled to slow down to ensure that red light running does not occur.

[0064] Controlling the vehicle to decelerate may specifically include: controlling the vehicle to decelerate in a stepwise manner or at a fixed speed, so that the vehicle stops within a standard stopping range of the stop line at the intersection.

[0065] For example, the central control system of the vehicle can be used to control the vehicle to gradually decelerate to 50% of the current speed; if it is detected that the distance between the vehicle and the stop line of the intersection is less than 10m during the deceleration process, the central control system of the vehicle will continue to control the vehicle to gradually decelerate to 20% to 30% of the current speed; if it is detected that the distance between the vehicle and the stop line of the intersection is less than 5m during the deceleration process, the central control system of the vehicle will control the vehicle to continue to gradually decelerate to 0, and if the speed has not yet decelerated to 0 and the distance to the stop line of the intersection is less than 1m, the central control system will control the vehicle to brake. In this way, the vehicle can be controlled to decelerate in a step-by-step manner, so that the vehicle stops within the standard stopping range of the stop line of the intersection.

[0066] It should be noted that the distance values ​​and speed values ​​listed above can be adjusted as needed, as long as the vehicle can be stably and timely controlled to stop within the standard stopping range of the intersection stop line through step-by-step deceleration.

[0067] Of course, according to actual working conditions, the vehicle can also be controlled to decelerate at an appropriate fixed speed, as long as stable deceleration can be achieved and the vehicle can be controlled to stop within the standard stopping range of the stop line at the intersection.

[0068] The third driving condition to be regulated that triggers a red light reminder is when a vehicle exceeds the stop line at an intersection and the traffic light that matches the direction of movement of the vehicle is a red light.

[0069] For example, when a vehicle exceeds the stop line of an intersection, and the vehicle is in motion and moving in the direction of a straight ahead, and the traffic light is a red light for straight ahead, the vehicle's speaker can be controlled to issue a voice reminder of "You have run a red light (or a red light for straight ahead), please obey traffic rules" or similar expressions, the vehicle's display screen can be controlled to dynamically and flash to display the real-time status of the traffic light ahead, and the vehicle's seat cushion can be controlled to issue a slight vibration reminder. When a vehicle exceeds the stop line of an intersection, and the vehicle is in motion and moving in the direction of a left turn, and the traffic light is a red light for left turn or there is no left turn signal but a red light for straight ahead, the vehicle's speaker can be controlled to issue a voice reminder of "You have run a red light (or a red light for left turn), please obey traffic rules" or similar expressions, the vehicle's display screen can be controlled to dynamically and flash to display the real-time status of the traffic light ahead, and the vehicle's seat cushion can be controlled to issue a slight vibration reminder. When a vehicle exceeds the stop line of an intersection, and the vehicle is in motion and the direction of motion is to turn right, and the traffic light is a red light for right turn, the vehicle's speaker can be controlled to issue a voice reminder of "You have run a red light (or a red light for right turn), please obey traffic rules" or similar expressions, the vehicle's display screen can be controlled to dynamically and flash a display reminder of the real-time status of the traffic light ahead, and the vehicle's seat cushion can be controlled to issue a slight vibration reminder. In this way, it can serve to remind the user to stop the ongoing red light running behavior.

[0070] Furthermore, in the case of the third driving condition that triggers a red light reminder and awaits standardization, in addition to controlling the vehicle to issue a vibration reminder and a standardized driving voice reminder and / or a standardized driving display reminder corresponding to the third driving condition that triggers a red light reminder and awaits standardization, if the user has already run a red light, the violation information can be uploaded to the traffic management system to help maintain traffic order, build a vehicle intelligent management system, achieve standardized riding of urban vehicles, reduce traffic accidents, and build a diversified and orderly intelligent transportation system and a harmonious and civilized city.

[0071] The fourth driving condition to be regulated that triggers a red light reminder is that the vehicle enters the third preset distance range of the stop line of the intersection or the vehicle exceeds the stop line of the intersection, the traffic light matching the direction of movement of the vehicle turns green, and the vehicle stops for more than a preset time. The third preset distance range can be set as needed.

[0072] For example, when a vehicle exceeds the stop line at an intersection, is not in motion, or the traffic light turns green, but the vehicle stops for a long time, the vehicle can be controlled to issue a standard driving voice reminder and / or a standard driving display reminder corresponding to the fourth type of standard driving condition that triggers a red light reminder (for example, the vehicle speaker is controlled to issue a voice reminder such as "To protect your travel safety, please do not stay at the intersection for a long time", and the seat cushion of the vehicle is controlled to issue a slight vibration reminder. In this way, it can serve to remind users to avoid staying at the intersection for a long time after the red light ends.

[0073] In the case of the above-mentioned driving condition that triggers the red light reminder and needs to be regulated, the traffic signal light big data system can also be combined to predict the situation where the green light turns red. For example, it can be predicted how many seconds the green light at the intersection ahead will turn red, so as to remind the user in advance to avoid running a red light.

[0074] S130b, judging whether the current driving condition triggers a driving condition to be regulated for a collision reminder based on the obstacle state information and the motion state information in the road condition information; wherein the obstacles include pedestrians, surrounding vehicles and roadblock signs.

[0075] Specifically, when there is an obstacle within a preset range of the vehicle and the vehicle will collide with the obstacle if it continues to move with the current driving intention, the current driving condition is determined to be a driving condition to be regulated that triggers a collision reminder.

[0076] The preset range is, for example, 30 m, but is not limited thereto.

[0077] For example, when the vehicle is in motion and a pedestrian is detected within a range of 30m, the seat cushion of the vehicle is controlled to vibrate and remind, and the vehicle is controlled to issue a standard driving voice reminder and / or a standard driving display reminder corresponding to the obstacle situation; for example, the speaker of the vehicle can be controlled to issue a voice reminder such as "There is a pedestrian ahead, please slow down and avoid collision", and the display screen of the vehicle is controlled to display the pedestrian ahead in animation and the screen flashes. When the vehicle is in motion and a vehicle is detected within a range of 30m, the seat cushion of the vehicle is controlled to vibrate and remind, and the vehicle is controlled to issue a standard driving voice reminder and / or a standard driving display reminder corresponding to the obstacle situation; for example, the speaker of the vehicle can be controlled to issue a voice reminder such as "There is a vehicle ahead, please slow down and avoid collision", and the display screen of the vehicle is controlled to display the vehicle ahead in animation and the screen flashes. In this way, it serves to remind the user to avoid collision between the user and the pedestrian / vehicle ahead.

[0078] Furthermore, when it is determined that the current driving condition triggers a collision reminder, the vehicle is controlled to decelerate to avoid the collision in order to ensure that the collision does not occur. The vehicle is controlled to decelerate in steps or at a constant speed.

[0079] For example, when a vehicle is in motion and a pedestrian / vehicle is detected within a range of 30m, the vehicle's central control system controls the vehicle to gradually decelerate to 50% of the current speed; if the pedestrian / vehicle is detected to be less than 10m away during the deceleration process, the central control system continues to control the vehicle to gradually decelerate to 20% to 30% of the current speed; if the pedestrian / vehicle is detected to be less than 5m away during the deceleration process, the central control system controls the vehicle to continue to gradually decelerate to 0; if the speed has not yet decelerated to 0 and the distance is less than 1m, the central control system controls the vehicle to brake.

[0080] S130c, judging whether the current driving condition triggers a driving condition to be regulated for lane occupation reminder based on the lane information and the motion state information in the road condition information.

[0081] When the means of transportation is a non-motor vehicle such as a bicycle or electric motorcycle, the driving conditions that need to be standardized for lane occupation reminders include the vehicle occupying the sidewalk / motor vehicle lane for a long time, driving in the opposite direction on the sidewalk / motor vehicle lane, etc.

[0082] In some embodiments, in the following two cases, it can be determined that the current driving condition triggers the unregulated driving condition for the lane-occupying reminder. In the case of the corresponding unregulated driving condition that triggers the lane-occupying reminder, the vehicle can be controlled to issue the corresponding standardized driving voice reminder and / or standardized driving display reminder and vibration reminder. Furthermore, in the case of determining that the current driving condition triggers the unregulated driving condition for the lane-occupying reminder, in order to ensure that a collision does not occur, the vehicle is also controlled to decelerate in a stepwise or uniform manner to avoid a collision.

[0083] The first type of driving condition that triggers the lane occupation reminder and needs to be regulated is when the vehicle is driving in the opposite direction on the matching lane, including non-motor vehicles driving in the opposite direction on the non-motor vehicle lane and motor vehicles driving in the opposite direction on the motor vehicle lane.

[0084] In the first case of the driving condition that triggers the lane occupation reminder and needs to be regulated, the vehicle can be controlled to issue a voice reminder and / or a vibration reminder to prompt the user to stop driving in the opposite direction; further, the vehicle can be controlled to slow down to ensure driving safety.

[0085] For example, when a vehicle is detected driving in the opposite direction on its corresponding matching lane: if there are no obstacles such as pedestrians / surrounding vehicles within 30m in the driving area in front of the vehicle, the vehicle can be controlled to issue a voice reminder of "Do not drive in the opposite direction" or similar expressions, and the seat cushion of the vehicle can be controlled to issue a slight vibration reminder; if it is detected after the voice reminder that the vehicle has not made corresponding adjustments within the set time range, a further voice reminder of "To protect your travel safety, the vehicle is about to slow down slowly, please drive safely according to traffic regulations" or similar expressions will be given, and the vehicle will be controlled to slow down slowly through the vehicle's central control system.

[0086] The second type of driving condition that triggers the lane occupation reminder and needs to be regulated is that the vehicle is moving forward or reverse in a non-matching lane.

[0087] Take non-motorized vehicles as an example.

[0088] When a vehicle is detected on the sidewalk and is moving: if there are no pedestrians within 30m in the driving area in front of the vehicle, the vehicle is controlled to issue a voice reminder of "Do not drive on the sidewalk" or similar expressions, and the seat cushion of the vehicle is controlled to issue a slight vibration reminder; if it is detected after the voice reminder that the vehicle has not made corresponding adjustments within the set time range, a further voice reminder is given: "To protect your travel safety, the vehicle will slowly decelerate in 2 seconds, please drive safely according to traffic regulations" or similar expressions, and the vehicle is controlled through the vehicle's central control system to slowly decelerate to 20% to 30% of the current speed.

[0089] When it is detected that a vehicle is on a motor vehicle lane, the vehicle is moving forward, and the time is greater than a set threshold: if a vehicle is detected within 30m in the driving area in front of the vehicle, the vehicle is controlled to issue a voice reminder of "There is a vehicle ahead, please slow down and avoid collision" or similar expressions, and the seat cushion of the vehicle is controlled to issue a slight vibration reminder; if it is detected after the voice reminder that the vehicle has not made corresponding adjustments within the set time range, a further voice reminder of "To protect your travel safety, the vehicle will slowly decelerate in 2 seconds, please drive safely according to traffic regulations" or similar expressions is given, and the vehicle is controlled through the central control system of the vehicle to slowly decelerate to 30-50% of the current speed; if there is no vehicle within 30m in the driving area in front of the vehicle, the vehicle is controlled to issue a voice reminder of "Do not drive on the motor vehicle lane" or similar expressions.

[0090] When it is detected that a vehicle is going against the flow on the motor vehicle lane, and the time is greater than the set threshold: the vehicle is controlled to issue a voice reminder of "You are going against the flow, please obey the traffic rules" or similar expressions, and the seat cushion of the vehicle is controlled to issue a slight vibration reminder; if it is detected that the vehicle has not made corresponding adjustments within the set time range after the voice reminder, a further voice reminder of "To protect your travel safety, the vehicle will slowly decelerate in 2 seconds, please drive safely according to the traffic regulations" or similar expressions will be issued. In addition, the vehicle is controlled by the central control system to slowly decelerate to 0, and the violation information is uploaded to the traffic management system to help establish an intelligent management system for vehicles, realize the standardized riding of urban vehicles, reduce traffic accidents, and build a diversified and orderly intelligent transportation system and a harmonious and civilized city.

[0091] The third type of driving condition that triggers the lane occupation reminder and needs to be regulated is that the vehicle is in a non-matching lane and stays there for a preset time.

[0092] For example, if a vehicle is detected on the sidewalk and the stay time is greater than a set threshold, the vehicle is controlled to issue a voice reminder such as "After unlocking the vehicle, please do not stay on the sidewalk for a long time to avoid occupying the sidewalk" or similar statements.

[0093] Furthermore, in each of the above embodiments, when the current driving condition triggers the driving condition to be regulated, a reminder message corresponding to the driving condition to be regulated may also be sent to a communication device authorized for interaction among the communication devices around the vehicle; wherein the communication device includes a mobile communication device and a vehicle-mounted communication device, and the reminder information includes the position information and / or motion information of the vehicle relative to the communication device.

[0094] The communication devices around the vehicle include the communication devices of the surrounding pedestrians and vehicles. When the vehicle triggers the driving condition to be regulated, the communication devices authorized to interact with the traffic management system (hereinafter referred to as the target communication devices) are screened out from the communication devices around the vehicle, and the location information and / or movement information of the vehicle relative to the target communication devices are sent to the target communication devices, so that the target communication devices can avoid the vehicle in time to avoid traffic accidents.

[0095] Figure 3 The main steps of another intelligent sensing vehicle control method are shown. Figures 1 to 3 As shown, in this embodiment, the vehicle is a shared vehicle; the intelligent sensing vehicle control method includes:

[0096] S110 , in response to an unlocking request of a vehicle, obtaining historical irregular behaviors of a current user account that issues the unlocking request.

[0097] S120, during the unlocking process of the vehicle, obtaining corresponding control instructions according to the historical irregular behaviors of the current user account.

[0098] The acquired control instructions include, for example, controlling the vehicle to issue a voice warning prompt and / or display a warning prompt related to historical irregular behaviors.

[0099] S130, analyzing the current driving condition of the vehicle in response to the road condition information and / or motion state information collected by the collection device.

[0100] S140', when the current driving condition triggers the driving condition to be standardized, the vehicle is controlled to issue a reminder corresponding to the driving condition to be standardized, and the non-standard behavior represented by the current driving condition is bound and stored with the corresponding user account.

[0101] Among them, the reminder corresponding to the driving condition to be standardized may include: a voice reminder and / or a display reminder corresponding to the driving condition to be standardized, a vibration reminder of the user's contact part, and the like.

[0102] By binding and storing the irregular behaviors characterized by the current driving conditions with the corresponding user accounts, the use behaviors of each user account on the transportation tool are recorded. In this way, when the corresponding user account requests to unlock the transportation tool, the historical irregular behaviors of the corresponding user account can be obtained, and the transportation tool can be controlled to issue voice warning prompts and / or display warning prompts related to the historical irregular behaviors (for example, a voice warning prompt "It is detected that you ran a red light yesterday, please be sure to obey traffic rules and do not ride illegally" can be issued) so that the corresponding user can understand his or her historical irregular behaviors before riding and avoid violating the rules again.

[0103] Furthermore, in some embodiments, the intelligent sensing vehicle control method further includes: in response to a dialogue command, controlling the vehicle to enter a dialogue mode; in response to an inquiry command for driving-related information, controlling the vehicle to feedback a corresponding voice answer and / or display answer.

[0104] Under normal driving conditions, vehicles can implement AI large model dialogue functions. Specifically, when the vehicle is in normal driving conditions, that is, not in the above-mentioned driving conditions to be standardized, the user can choose to enter the chat dialogue mode, initiate a request through a dialogue command (for example, "Hello, Xiaoha", but not limited to this), and the vehicle enters the dialogue mode in response to the dialogue command. Then, the user can issue driving-related information inquiry commands, such as "Are there pedestrians ahead?", "Please explain the road conditions ahead", "How long does it take to get from this location to a certain place?", "Please navigate to a certain place", etc. (inquiry commands include but are not limited to chat content such as instant information consultation in non-motor vehicle driving scenarios), and the microphone of the vehicle recognizes the user's voice command and perceives the surrounding environment and makes voice answers and / or displays answers.

[0105] For example, if the inquiry command is recognized as navigation or location consultation: the display screen will display the map, navigation route, etc. in real time, and the corresponding answer will be announced by voice, such as "The current vehicle speed is xx, and it is about xx minutes from here to a certain place", "The destination has been planned for you, please choose a suitable route and drive safely." If it is other conversation content, such as "Are there pedestrians ahead?", "Please explain the road conditions ahead", etc.: the corresponding answer will be announced by voice. If it is content that the system does not understand: the voice will announce "Xiao Ha does not understand the question, please continue to ask questions" or similar expressions. If the user does not ask a question for a long time (exceeding the set time threshold): the voice will announce "Xiao Ha has not detected that you have asked a question for a long time, so it will exit first. Please pay attention to driving safety, wish you a pleasant journey, and welcome to use it again" or similar expressions.

[0106] If the user does not need to use the AI ​​large model dialogue function, he or she can choose to turn off the corresponding function on the optional touch button on the display screen of the client and the vehicle.

[0107] An embodiment of the present invention further provides an intelligent perception vehicle control system, which can be used to implement the intelligent perception vehicle control method described in any of the above embodiments.

[0108] Figure 4 The main modules of intelligent sensing vehicle control system are shown in Figure 2. Figure 4 As shown, the intelligent perception vehicle control system 400 provided in the embodiment of the present invention includes:

[0109] The operating condition analysis module 410 is configured to: analyze the current driving condition of the vehicle in response to the road condition information and / or motion state information collected by the collection device;

[0110] The reminder control module 420 is configured to: when the current driving condition triggers the driving condition to be standardized, control the vehicle to issue a reminder corresponding to the driving condition to be standardized.

[0111] Furthermore, the intelligent perception vehicle control system 400 may also include modules for implementing other process steps of the above-mentioned intelligent perception vehicle control method embodiments. The specific principles of each module can refer to the description of the above-mentioned intelligent perception vehicle control method embodiments, and will not be repeated here.

[0112] The intelligently perceived vehicle control system of the present invention collects road condition information and vehicle motion state information in real time through the collection equipment loaded on the vehicle, so as to realize the real-time intelligent perception and judgment of the whole process of vehicle driving; when the current driving condition triggers the driving condition to be standardized, the vehicle is controlled to issue a reminder corresponding to the driving condition to be standardized, for example, the user is directly and timely reminded of the perception through the vibration reminder of the user's contact part, and the user is accurately informed of the triggered driving condition to be standardized through voice reminder and / or display reminder, etc., thereby timely and accurately managing the user's behavior of using the vehicle, prompting the user to use the vehicle in a standardized manner, so as to ensure orderly and safe traffic. In addition, in the case of a user's violation of traffic rules, the violation information is uploaded to the traffic management system to help establish an intelligent management system for vehicles, reduce traffic accidents, and build a diversified and orderly intelligent transportation system and a harmonious and civilized city.

[0113] An embodiment of the present invention further provides an electronic device, including a processor and a memory, wherein executable instructions are stored in the memory, and when the executable instructions are executed by the processor, the intelligent perception vehicle control method described in any of the above embodiments is implemented.

[0114] The electronic device can be deployed on the vehicle, or deployed remotely, in the cloud, etc. and communicated with the vehicle.

[0115] Figure 5 The structure of the electronic device is shown schematically. It should be understood that Figure 5 The main modules of the electronic device are only schematically shown, and these modules may be virtual software modules or actual hardware modules. The combination and splitting of these modules and the addition of other modules are all within the protection scope of the present invention.

[0116] like Figure 5As shown, the electronic device 500 is in the form of a general computing device. The components of the electronic device 500 include but are not limited to: at least one processor 510, at least one memory 520, a bus 530 connecting different platform components (including the memory 520 and the processor 510), etc.

[0117] The memory 520 stores program codes, which can be executed by the processor 510, so that the processor 510 executes the steps of the intelligent perception vehicle control method described in any of the above embodiments.

[0118] The memory 520 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) and / or a cache memory, and may further include a read-only memory unit (ROM). The memory 520 may also include a program / utility having one or more program modules, such program modules including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include the implementation of a network environment.

[0119] Bus 530 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0120] The electronic device 500 can also communicate with one or more external devices, and the external device can be one or more of the devices such as keyboard, pointing device, bluetooth device, etc. These external devices enable the user to communicate interactively with the electronic device 500. The electronic device 500 can also communicate with one or more other computing devices, and the computer device shown includes a router and a modem. This communication can be carried out through an input / output (I / O) interface. In addition, the electronic device 500 can also communicate with one or more networks (such as local area network (LAN), wide area network (WAN) and / or public network, such as the Internet) through a network adapter. The network adapter can communicate with other modules of the electronic device 500 through the bus 530.

[0121] An embodiment of the present invention further provides a computer-readable storage medium for storing a program, which, when executed, implements the intelligent perception vehicle control method described in any of the above embodiments.

[0122] The storage medium may be executed by a processor deployed on board the vehicle, or by a processor deployed remotely, in the cloud, etc., and in communication connection with the vehicle.

[0123] The storage medium may be a portable compact disk read-only memory (CD-ROM) and include program code, and may be run on a terminal device, such as a processor of a vehicle. However, the storage medium of the present invention is not limited thereto, and may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0124] The storage medium may be any combination of one or more readable media, and the readable medium may be a readable signal medium or a readable storage medium.

[0125] The program code may be executed entirely on the terminal device, partially on the terminal, as an independent software package, partially on the terminal and partially on the remote device, or entirely on the remote device or server. In the case of a remote device, the remote device may be connected to the terminal device via any type of network, including a local area network (LAN) or a wide area network (WAN).

[0126] The embodiment of the present invention also provides a computer program product, including a computer program, which, when executed by a processor, implements the intelligent sensing vehicle control method described in any of the above embodiments. The computer program can be executed by a processor deployed on the vehicle, or by a processor deployed remotely, in the cloud, etc. and connected to the vehicle for communication.

[0127] The above contents are further detailed descriptions of the present invention in combination with specific preferred embodiments, and it cannot be determined that the specific implementation of the present invention is limited to these descriptions. For ordinary technicians in the technical field to which the present invention belongs, several simple deductions or substitutions can be made without departing from the concept of the present invention, which should be regarded as falling within the protection scope of the present invention.

Claims

1. A method for controlling a vehicle with intelligent perception, characterized in that: include: In response to the road condition information and / or the motion state information of the vehicle collected by the collection device, analyzing the current driving condition of the vehicle; When the current driving condition triggers the driving condition to be regulated, the vehicle is controlled to issue a reminder corresponding to the driving condition to be regulated.

2. The vehicle control method according to claim 1, characterized in that: The collection device is loaded on the vehicle.

3. The vehicle control method according to claim 1, characterized in that: The collection device includes a camera capable of collecting the road condition information and / or a sensor capable of collecting the motion state information.

4. The vehicle control method according to claim 1, characterized in that: The controlling the vehicle to issue a reminder corresponding to the driving condition to be regulated includes: Controlling the vehicle to issue a voice reminder and / or a display reminder corresponding to the driving condition to be regulated; and / or The vehicle is controlled to emit a vibration reminder.

5. The vehicle control method according to claim 1, characterized in that: The analyzing the current driving condition of the vehicle includes: Determining whether the current driving condition triggers a red light reminder driving condition to be regulated according to the traffic light state information and / or the motion state information in the road condition information; The motion state information includes one or more of the position, speed and motion direction of the vehicle.

6. The vehicle control method according to claim 5, characterized in that: In any of the following cases, it is determined that the current driving condition triggers the red light reminder driving condition to be regulated: The vehicle enters within a first preset distance range of the stop line of the intersection; The vehicle enters within a second preset distance range of the stop line at the intersection, and the traffic light is red at any time during the process in which the vehicle moves to the stop line at the intersection with the current driving intention; The vehicle exceeds the stop line of the intersection, and the traffic light that matches the direction of movement of the vehicle is a red light; The vehicle enters the third preset distance range of the stop line of the intersection or exceeds the stop line of the intersection, the traffic light matching the movement direction of the vehicle turns green, and the vehicle stays for more than a preset time.

7. The vehicle control method according to claim 6, characterized in that: The traffic light is a red light at any time when the vehicle moves to the stop line of the intersection with the current driving intention, including: The traffic light is currently red and the speed of the vehicle is not zero; The traffic light will turn red when the vehicle moves to the stop line of the intersection at the current speed.

8. The vehicle control method according to claim 6, characterized in that: When the vehicle enters the second preset distance range of the stop line at the intersection and the traffic light is red at any time during the process of the vehicle moving to the stop line at the intersection with the current driving intention: The vehicle is controlled to decelerate.

9. The vehicle control method according to claim 1, characterized in that: The analyzing the current driving condition of the vehicle includes: According to the obstacle state information and the motion state information in the road condition information, it is determined whether the current driving condition triggers a driving condition to be regulated for a collision reminder.

10. The vehicle control method according to claim 9, characterized in that: When the obstacle exists within a preset range of the vehicle and the vehicle will collide with the obstacle if it continues to move with the current driving intention, it is determined that the current driving condition triggers the driving condition to be regulated for the collision reminder.

11. The vehicle control method according to claim 9 or 10, characterized in that: Obstacles include one or more of pedestrians, surrounding vehicles or roadblock signs.

12. The vehicle control method according to claim 1, characterized in that: The analyzing the current driving condition of the vehicle includes: According to the lane information in the road condition information and the motion state information, it is determined whether the current driving condition triggers a driving condition to be regulated for lane occupation reminder.

13. The vehicle control method according to claim 12, characterized in that: In any of the following cases, it is determined that the current driving condition triggers the lane occupying reminder driving condition to be standardized: The vehicle is traveling in the wrong direction on the matching lane; The vehicle is traveling forward or in the opposite direction on a non-matching lane; The vehicle is located in a non-matching lane and stays there for a preset time period.

14. The vehicle control method according to claim 10 or 13, characterized in that: When it is determined that the current driving condition triggers a driving condition to be regulated for a collision reminder or a driving condition to be regulated for a lane-occupying reminder: When the vehicle speed is not zero, the vehicle is controlled to decelerate.

15. The vehicle control method according to any one of claims 4, 6, 10 and 13, characterized in that: In different situations, the vehicle is controlled to issue standard driving voice reminders and / or standard driving display reminders corresponding to different situations.

16. The vehicle control method according to claim 1, characterized in that: When the current driving condition triggers the driving condition to be regulated, a reminder message corresponding to the driving condition to be regulated is also sent to a communication device authorized to interact among the communication devices around the vehicle; Wherein, the communication equipment includes mobile communication equipment and vehicle-mounted communication equipment.

17. The vehicle control method according to claim 1, characterized in that: Also includes: In response to the dialogue command, controlling the vehicle to enter a dialogue mode; In response to an inquiry instruction for driving-related information, the vehicle is controlled to feedback a corresponding voice answer and / or display answer.

18. An intelligent sensing vehicle control system, characterized in that: A method for implementing the intelligent perception vehicle control method according to any one of claims 1 to 17, wherein the intelligent perception vehicle control system comprises: A working condition analysis module, configured to: analyze the current driving condition of the vehicle in response to the road condition information and / or motion state information collected by the collection device; The reminder control module is configured to: when the current driving condition triggers the driving condition to be standardized, control the vehicle to issue a reminder corresponding to the driving condition to be standardized.

19. An electronic device, characterized in that: include: processor; A memory, wherein executable instructions are stored in the memory; Wherein, when the executable instructions are executed by the processor, the intelligent perception vehicle control method described in any one of claims 1-17 is implemented.

20. A computer-readable storage medium for storing a program, characterized in that: When the program is executed by a processor, the intelligent perception vehicle control method described in any one of claims 1-17 is implemented.

21. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the intelligent perception vehicle control method according to any one of claims 1 to 17 is implemented.

Images