Vehicle control method, device, equipment and storage medium

By obtaining and analyzing vehicle environmental information, determining the location and passing status of the target object, formulating control strategies and displaying information, it solves the problem that autonomous vehicles are difficult to convey driving intentions in scenarios such as road intersections, and improves driving safety and customer experience .

CN115303300BActive Publication Date: 2024-11-01CHONGQING CHANGAN TECH CO LTD
View PDF 13 Cites 0 Cited by

Patent Information

Application Number
CN202211049071.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-08-30
Publication Date
2024-11-01
Estimated Expiration
2042-08-30

AI Technical Summary

Technical Problem

During the driving process of autonomous vehicles, it is difficult to effectively realize the existing technology how to promptly convey the vehicle's driving status and intentions to pedestrians, especially in scenarios such as road intersections and pedestrian crossings.

Method used

By obtaining the current environment information of the vehicle, including road surface images, roadside images, radar data, target detection, determine the road position and passing state of the target object, formulate control and display strategies based on this information, control the vehicle and display it through visual or auditory visual or auditory The device conveys information to pedestrians.

Benefits of technology

It realizes effective interaction between vehicles and pedestrians, improves driving safety and customer experience, and ensures that pedestrians can understand the vehicle's driving intentions in a timely manner.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115303300B_ABST
    Figure CN115303300B_ABST
Patent Text Reader

Abstract

The present application provides a vehicle control method, device, equipment and storage medium. The method obtains the current environmental information of the vehicle, performs target detection on the current environmental information, and obtains the target existence state of the target object. If the target existence state is existence, the road position information of the target object is determined according to the current environmental information to determine the road travel state of the target object. The vehicle control and display strategy is determined based on at least one of the target existence state and the road travel state, and the vehicle is controlled according to the control and display strategy. The current driving state and driving intention of the vehicle can be transmitted to pedestrians in a timely manner so that pedestrians can understand the driving intention of the vehicle in a timely manner, thereby further improving the driving safety of the vehicle and improving the customer experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of vehicle technology, and specifically to a vehicle control method, device, equipment and storage medium. Background Art

[0002] The current automobile technology is becoming more and more mature, and autonomous driving vehicles can already achieve point-to-point autonomous driving. The autonomous driving function is realized through environmental perception sensors that perceive the road environment, combined with high-precision maps, and through autonomous driving controllers and related algorithms.

[0003] However, when driving on the road, there is a lack of interaction between the vehicle and the pedestrians outside the vehicle. When the vehicle is driving on the road, it will intersect with pedestrians on the road at traffic intersections, crosswalks, etc. In the above scenarios, how to timely convey the vehicle's current driving status and driving intention to pedestrians so that pedestrians can understand the vehicle's driving intention in a timely manner is a technical problem that road vehicles, especially autonomous vehicles, need to solve. Summary of the invention

[0004] In view of the above-mentioned shortcomings of the prior art, the embodiments of the present invention provide a vehicle control method, device, equipment and storage medium to solve the above-mentioned technical problems.

[0005] The vehicle control method provided by the embodiment of the present invention includes:

[0006] Acquire current environment information of the vehicle, the current environment information including at least one of a current road surface image, a current roadside image, current road surface radar data, and current roadside radar data;

[0007] Performing target detection on the current environment information to obtain a target existence state of a target object;

[0008] If the target existence state is existence, determining the road position information of the target object according to the current environment information to determine the road travel state of the target object;

[0009] A control and display strategy for the vehicle is determined based on at least one of the target existence state and the road traveling state, and the vehicle is controlled according to the control and display strategy.

[0010] In one embodiment of the present invention, if the target existence state is existence, determining the road position information of the target object according to the current environment information to determine the road travel state of the target object includes:

[0011] Determine the road location information of the target object according to the current environment information, wherein the road location information includes a roadside or a road middle;

[0012] If the road position information is a roadside, historical information is obtained, and the road travel status of the target object is determined according to the historical information and the road position information, wherein the historical information includes at least one of historical road surface images, historical roadside images, historical road surface radar data, and historical roadside radar data.

[0013] In one embodiment of the present invention, determining the road travel state of the target object according to the historical information and the road position information includes:

[0014] Determine the historical location information of the target object according to the historical information, wherein the historical location information includes a roadside or a road middle;

[0015] If the historical location information is different from the road location information, determining the road crossing state as no intention to cross the road;

[0016] If the historical position information is the same as the road position information, the road crossing state is determined as waiting to cross the road.

[0017] In one embodiment of the present invention, the method further includes at least one of the following:

[0018] If the road crossing state is determined to be no intention to cross the road, the control and display strategy includes controlling the vehicle to drive slowly, and controlling the external display device of the vehicle to display first display information, wherein the first display information is used to indicate that the vehicle is passing;

[0019] If the road crossing state is determined to be waiting to cross the road, the control and display strategy includes controlling the vehicle to stop, and controlling the external display device of the vehicle to display second display information, wherein the second display information is used to indicate that the vehicle is in a stopped state and the target object is requested to pass;

[0020] If the road position information is in the middle of the road, the road traveling status includes that the target object is traveling on the road surface, and the control and display strategy includes controlling the vehicle to stop, and controlling the external display device of the vehicle to display the second display information.

[0021] In one embodiment of the present invention, if the road crossing state is determined to be waiting to cross the road, the method further includes:

[0022] Monitoring the road travel status of the target object;

[0023] If the road crossing state is waiting to cross the road, and the duration of the road crossing state is greater than the preset duration threshold, the road crossing state is updated to no intention to cross the road;

[0024] The control and display strategy includes controlling the vehicle to drive slowly, and controlling an external display device of the vehicle to display the first display information.

[0025] In one embodiment of the present invention, the external display device includes at least one of an auditory display device and a visual display device;

[0026] If the external display device includes an auditory display device, the display method of the first display information and / or the second display information includes sound display;

[0027] If the external display device includes a visual display device, the display method of the first display information and / or the second display information includes at least one of light display, text display, graphic display and symbol display.

[0028] In one embodiment of the present invention, the first display information is also used to display the current driving speed of the vehicle.

[0029] In one embodiment of the present invention, if the target existence state includes non-existence, the control and display strategy includes:

[0030] Obtaining road conditions ahead of the vehicle;

[0031] If the road condition ahead includes a crosswalk or an intersection, the external display device of the vehicle is controlled to display first display information, where the first display information is used to indicate that the vehicle is passing.

[0032] An embodiment of the present invention provides a vehicle control device, the device comprising:

[0033] An acquisition module, used to acquire current environmental information of the vehicle, wherein the current environmental information includes at least one of a current road surface image, a current roadside image, current road surface radar data, and current roadside radar data;

[0034] A target detection module is used to perform target detection on the current environment information to obtain the target existence state of the target object;

[0035] A state determination module, configured to determine the road position information of the target object according to the current environment information if the target existence state is existence, so as to determine the road travel state of the target object;

[0036] A control module is used to determine a control and display strategy for the vehicle based on at least one of the target existence state and the road traveling state, and control the vehicle according to the control and display strategy.

[0037] An embodiment of the present invention provides an electronic device, the electronic device comprising:

[0038] one or more processors;

[0039] A storage device is used to store one or more programs, and when the one or more programs are executed by the one or more processors, the electronic device implements the vehicle control method described in any of the above embodiments.

[0040] An embodiment of the present invention provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor of a computer, the computer executes the vehicle control method described in any one of the above embodiments.

[0041] Beneficial effects of the embodiments of the present invention: The vehicle control method, device, equipment and storage medium in the embodiments of the present invention, the method obtains the current environmental information of the vehicle, performs target detection on the current environmental information, and obtains the target existence state of the target object. If the target existence state is existence, the road position information of the target object is determined according to the current environmental information to determine the road travel state of the target object, and the vehicle control and display strategy is determined based on at least one of the target existence state and the road travel state, and the vehicle is controlled according to the control and display strategy, which can timely convey the current driving state and driving intention of the vehicle to pedestrians so that pedestrians can timely understand the driving intention of the vehicle, further improving the vehicle driving safety and improving customer experience.

[0042] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0044] Figure 1 is a schematic diagram of an implementation environment shown in an exemplary embodiment of the present application;

[0045] Figure 2 is a flow chart of a vehicle control method shown in an exemplary embodiment of the present application;

[0046] Figure 3 is a flowchart of current environment information collection and target detection shown in an exemplary embodiment of the present application;

[0047] Figure 4 is a schematic diagram of a display process of first display information or second display information shown in an exemplary embodiment of the present application;

[0048] Figure 5 is a flow chart of a vehicle control method shown in an exemplary embodiment of the present application;

[0049] Figure 6 is a block diagram of a vehicle control device shown in an exemplary embodiment of the present application;

[0050] Figure 7 is a block diagram of a vehicle control device shown in another exemplary embodiment of the present application;

[0051] Figure 8 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0052] The following will describe the embodiments of the present invention with reference to the accompanying drawings and preferred embodiments. Those skilled in the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and the details in this specification can also be modified or changed in various ways based on different viewpoints and applications without departing from the spirit of the present invention. It should be understood that the preferred embodiments are only for illustrating the present invention, not for limiting the scope of protection of the present invention.

[0053] It should be noted that the illustrations provided in the following embodiments are only schematic illustrations of the basic concept of the present invention, and thus the drawings only show components related to the present invention rather than being drawn according to the number, shape and size of components in actual implementation. In actual implementation, the type, quantity and proportion of each component may be changed arbitrarily, and the component layout may also be more complicated.

[0054] In the following description, numerous details are discussed to provide a more thorough explanation of the embodiments of the present invention. However, it is obvious to those skilled in the art that the embodiments of the present invention can be implemented without these specific details. In other embodiments, well-known structures and devices are shown in the form of block diagrams rather than in detail to avoid making the embodiments of the present invention difficult to understand.

[0055] Figure 1 FIG. 1 is a schematic diagram of an implementation environment shown in an exemplary embodiment of the present application. Figure 1As shown, the server 101 communicates with the vehicle-mounted terminal disposed inside the vehicle 102 through the network. The implementation device of the vehicle-mounted terminal includes but is not limited to any terminal device that supports the software generated by the vehicle control method, such as a personal computer, a laptop computer, a smart phone, a tablet computer, and a portable wearable device. The vehicle-mounted terminal is equipped with networked terminal software, such as a PC website, a mobile website, an Android APP, an iOS APP, a WeChat applet, a smart watch APP, a smart car APP, and other smart hardware applications. The server 101 can be implemented by an independent server or a server cluster composed of multiple servers, such as a TSP (Telematics Service Provider, automotive remote service provider) server. The server / server cluster can also be a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network, content distribution network), and basic cloud computing services such as big data and artificial intelligence platforms, which are not limited here. Environmental information can be collected by an image acquisition device installed on the vehicle, or by an image acquisition device installed on the road. Radar data can also be obtained as environmental information by means of vehicle-mounted radar, etc. The environmental information is uploaded to a server or directly sensed by a vehicle-mounted terminal inside the vehicle to obtain the target existence state of the target object. When the target existence state is existence, that is, when the target object exists in the environmental information, the road travel state of the target object is determined by detecting the environmental information, and then the control and display strategy of the vehicle is determined based on at least one of the road travel state and the target existence state. The vehicle is controlled based on the control and display strategy, for example, the vehicle is controlled to make a sound, display prompt text or animation, etc., to convey the current driving state of the vehicle to the target object, such as parking and waiting or slow travel, etc. The above process can be independently executed by a server, can be independently executed by a vehicle-mounted terminal, and can also be realized by interaction between a server and a vehicle-mounted terminal.

[0056] The embodiments of the present application respectively propose a vehicle control method, a vehicle control device, an electronic device, a computer-readable storage medium, and a computer program product, which will be described in detail below.

[0057] See also Figure 2 , Figure 2 is a flow chart of a vehicle control method shown in an exemplary embodiment of the present application. The method can be applied to Figure 1The implementation environment shown in the figure is specifically executed by the server 101 or the vehicle terminal in the implementation environment, or is jointly executed by the server and the vehicle terminal. It should be understood that the method can also be applied to other exemplary implementation environments and be specifically executed by devices in other implementation environments. This embodiment does not limit the implementation environment to which the method is applicable.

[0058] like Figure 2 As shown, in an exemplary embodiment, the vehicle control method at least includes steps S201 to S204, which are described in detail as follows:

[0059] Step S201, obtaining the current environment information of the vehicle.

[0060] The current environment information is collected by an image acquisition device and / or by a vehicle-mounted radar device. The image acquisition device may be a camera or other device installed on the vehicle, or may be a camera or other device installed at an intersection.

[0061] The current environment information includes at least one of the current road surface image, the current roadside image, the current road surface radar data, and the current roadside radar data. The current road surface image may be an image of the road surface including the road on which the vehicle is traveling, or may be an image of the scene seen from the driving position of the vehicle. The current roadside image may be an image of the roadside of the road on which the vehicle is traveling, such as a sidewalk on at least one side, a non-motorized vehicle lane, etc., collected by an image acquisition device arranged on the side of the vehicle. The current roadside image may also be collected by a camera arranged on the road. The current road surface radar data may be radar data of the road surface including the road on which the current vehicle is traveling, collected by a laser radar or a millimeter-wave radar arranged on the vehicle. The current roadside radar data may be radar data of the roadside of the road on which the current vehicle is traveling (such as a sidewalk or a non-motorized vehicle lane on at least one side) collected by a laser radar or a millimeter-wave radar arranged on the vehicle.

[0062] Smart driving vehicles are equipped with a variety of sensors. The image acquisition device can be a camera. The vehicle-mounted radar device includes but is not limited to at least one of the following: laser radar, millimeter wave radar, and ultrasonic radar. Among the many sensors, the camera is one of the most important sensors. The vehicle's environmental image can be collected as the current environmental information by using image acquisition devices such as cameras. The environmental image can be an image in front of and / or on the side of the vehicle, or an image within a preset distance range of the vehicle. When the image acquisition device is set on the vehicle, it can be a driving recorder of the vehicle. The image acquisition device can be an image in front of the vehicle's direction of travel, or an image in the direction of the vehicle's surroundings. Generally speaking, the vehicle may pose a threat to target objects that are or may be located within a certain range on its driving path. Therefore, in order to save computing power, only the image or radar data within a preset distance range in front of the vehicle's driving path can be determined as the current environmental information. For example, the vehicle itself is equipped with a millimeter wave radar and a camera, which can identify pedestrian information. This specific implementation method can be implemented by relevant technical means, which will not be repeated here. It is also possible to use the environmental images taken by cameras installed at intersections as current environmental information to identify pedestrian information. For example, taking pedestrians as the target object, a pedestrian recognition camera is installed at the traffic intersection to record the status of pedestrians on the road. The pedestrian information at the intersection is transmitted to the vehicle's on-board terminal device or server through the network, and then it can be analyzed whether there are pedestrians, and the pedestrian's road crossing status can be identified. Based on the road crossing status and whether there are pedestrians, the vehicle can be controlled to perform pedestrian courtesy operations, such as stopping, slowing down, etc.

[0063] The current environmental information can be collected through the vehicle's own radar and camera, or cameras installed at intersections, and the current environmental information can be transmitted to the vehicle's onboard terminal or server through the network.

[0064] Step S202: perform target detection on the current environment information to obtain the target existence status of the target object.

[0065] The current environmental information includes at least one of the two categories of image information and radar information. The method of performing target detection on the current environmental information can be implemented in a manner known to those skilled in the art, such as pre-training an image detection model or a radar data detection model for detecting target objects, so that the image detection model or the radar data detection model can output a target existence status of whether the target object exists by detecting the current environmental information. When the target object exists, that is, when the target existence status is exists, the road position information of the target object can continue to be output.

[0066] This process can use road perception technology in related technologies to perform real-time perception of current environmental information during vehicle driving (environmental perception) to determine whether there is a target object. When a target object exists, determine the position relationship of the target object on the current driving road, that is, the road position information, whether it is on the side of the road or in the middle of the road.

[0067] In one embodiment, see Figure 3 , Figure 3 FIG. 1 is a flowchart of current environment information collection and target detection shown in an exemplary embodiment of the present application. Figure 3 As shown, the target detection method can be: identifying pedestrian information through the vehicle's own radar and camera; identifying pedestrians through cameras installed at intersections; transmitting pedestrian information at intersections to vehicles through the network; fusing pedestrian information through pedestrian information processors to obtain pedestrian identification results, that is, the existence status and road position information of the target object. The pedestrian information processor can be set up on a server or in a vehicle-mounted terminal.

[0068] In one embodiment, the method can also adopt dual fusion of pedestrian perception modules, which is more reliable. The recognition of pedestrians by the vehicle's own radar and camera is integrated with the pedestrian information recognized by the camera installed at the intersection, so that pedestrian information can be recognized more accurately. The vehicle itself is equipped with millimeter-wave radar and camera, which can recognize pedestrian information. Cameras installed at intersections recognize pedestrian information: Pedestrian recognition cameras are installed at traffic intersections to record the status of pedestrians on the road; pedestrian information at the intersection is transmitted to vehicles through the network; vehicles perform pedestrian courtesy operations based on pedestrian information on the road.

[0069] Step S203, if the target existence status is existence, determine the road position information of the target object according to the current environment information to determine the road travel status of the target object.

[0070] Optionally, the road travel status of the target object may be determined based on the road position information of the target object.

[0071] In one embodiment, if the target existence state is existence, determining the road position information of the target object according to the current environment information to determine the road travel state of the target object includes:

[0072] Determine the road location information of the target object according to the current environment information, where the road location information includes the roadside or the middle of the road;

[0073] If the road location information is roadside, historical information is obtained, and the road travel status of the target object is determined based on the historical information and the road location information. The historical information includes at least one of historical road surface images, historical roadside images, historical road surface radar data, and historical roadside radar data.

[0074] The road position information of the target object is determined based on the image or radar data in the current environmental information. The corresponding image target detection model and radar data target detection model can be pre-trained respectively to achieve the detection of the target object. The method for determining the road position information can be implemented in a manner known to those skilled in the art and is not limited here.

[0075] In one embodiment, determining the road travel state of the target object according to the historical information and the road position information includes:

[0076] Determine historical location information of the target object according to historical information, where the historical location information includes a roadside or a road middle;

[0077] If the historical location information is different from the road location information, the road crossing state is determined as no intention to cross the road;

[0078] If the historical location information is the same as the road location information, the road crossing state is determined as waiting to cross the road.

[0079] The method of determining the historical position information based on the historical information is consistent with the method of determining the road position relationship based on the current environment information, and will not be repeated here.

[0080] If both the historical location information and the road location information are roadside, it means that the target object has been standing or walking on the roadside. At this time, it may have the intention to cross the road, so it is necessary to give way to it. Its road crossing status is determined as waiting to cross the road. On the contrary, if the historical location information is in the middle of the road and the road location information is roadside, it means that the target object has completed the road crossing. At this time, it may not have the intention to cross the road, so it is not necessary to give way to it. Its road crossing status is determined as no intention to cross the road.

[0081] Sometimes, there are a few pedestrians who have just finished crossing the road and need to cross the road again. At this time, in order to avoid misjudgment of this situation, the method also includes, if the historical location information is different from the road location information, obtaining the facial features of the target object. If the facial features exist and the face is facing the opposite side of the road where the target object is located, then the road crossing state is determined as waiting to cross the road. Otherwise, if there are no facial features, or if there are facial features but the face is facing the opposite side of the road where the target object is located, then the road crossing state is determined as no intention to cross the road. The direction of the face can be determined by determining the facial features and collecting the angle information of the facial feature points, and can also be achieved by other methods known to those skilled in the art.

[0082] Step S204, determining a control and display strategy for the vehicle based on at least one of the target existence state and the road traveling state, and controlling the vehicle according to the control and display strategy.

[0083] The control and display strategy at least includes displaying the first display information or the second display information.

[0084] When the target existence state of the target object is not present, the current road section information of the vehicle is obtained. If the current road section information is target information, the control and display strategy is to control the vehicle to slow down. If the current road section information is ordinary information, the control and display strategy is to control the vehicle to drive according to the original driving strategy. That is, the original driving strategy of the vehicle is not actively changed. Among them, the current road section information includes intersections, culverts, tunnels, schools, villages and other areas where laws and regulations require slowing down. The above current road section information can be determined as target information. The current road section information also includes other information other than the target information, such as highways, urban express lanes, and non-intersection roads. At this time, the vehicle's driving section is not a section that requires slowing down, so the vehicle can maintain its original driving strategy and continue to drive.

[0085] In one embodiment, if the road position information is in the middle of the road, the road traveling state includes that the target object is traveling on the road surface;

[0086] The control and display strategies include: controlling the parking of the vehicle, and controlling the external display device of the vehicle to display the parking of the vehicle and the information that the target object is requested to pass.

[0087] Among them, the parking position of the vehicle can be set by technical personnel in this field as needed, such as parking at a certain distance from the target object, or parking at a preset road traffic marking line position, such as the parking line of a crosswalk.

[0088] In some embodiments, after controlling the vehicle to stop, the method further includes:

[0089] Continue to collect current environmental information and perform target detection until the target object does not exist, or the road position information of the target object is determined to be the roadside based on the current environmental information, that is, the road crossing status of the target object at this time is that there is no intention to cross the road, then control the vehicle to start legally in a safe state (start under the premise of meeting the instructions of the road traffic indicator and the instructions of the road traffic light).

[0090] In some embodiments, when the target existence state is existence, before determining the road position information of the target object according to the current environment information to determine the road traveling state of the target object, the method further includes:

[0091] The identity of the target object is verified. If the target object is a traffic law enforcement officer, the gesture information of the traffic law enforcement officer is identified, and the vehicle control and display strategy is determined based on the gesture information, or the human attention is prompted to the vehicle driving status, and the road traffic instructions of the gesture information are prompted so that the vehicle driver can control the vehicle to drive according to the gesture information. If there is no gesture information, the step of determining the road position information of the target object is performed to determine the road travel status of the target object.

[0092] In some embodiments, before obtaining the current environment information of the vehicle, the method further includes:

[0093] If the vehicle is at an intersection with a traffic light, obtain the current indication color of the red light. If it is yellow or green, obtain the current environment information of the vehicle;

[0094] If it is red, the control and display strategy is parking.

[0095] In one embodiment, the method further comprises at least one of the following:

[0096] If the road crossing state is determined to be no intention to cross the road, the control and display strategy includes controlling the vehicle to drive slowly, and controlling the external display device of the vehicle to display first display information, where the first display information is used to indicate that the vehicle is passing;

[0097] If the road crossing state is determined to be waiting to cross the road, the control and display strategy includes controlling the vehicle to stop, and controlling the vehicle's external display device to display second display information, the second display information is used to indicate that the vehicle is in a stopped state, and the target object is requested to pass.

[0098] If the road position information is in the middle of the road, the road travel state includes the target object is traveling on the road surface, and the control and display strategy includes controlling the vehicle to stop, and controlling the vehicle's external display device to display the second display information. Based on the above manner, the method may also include controlling the vehicle to start driving when it is detected that the target object leaves the vehicle's driving lane or the target object reaches the roadside on the side where the target object's face is facing.

[0099] In some embodiments, if the road crossing state is determined to be waiting to cross the road, the method further includes:

[0100] Monitoring the road travel status of the target object, the road travel status can be determined by continuously collecting current environment information and determining the road travel status;

[0101] If the road crossing state is waiting to cross the road, and the duration of the road crossing state is greater than the preset duration threshold, the road crossing state is updated to no intention to cross the road; if the duration is less than the preset duration threshold, the waiting continues;

[0102] The control and display strategy includes controlling the vehicle to drive slowly, and controlling the external display device of the vehicle to display the first display information.

[0103] If the road crossing status changes to no intention to cross the road or the target object is crossing the road, the vehicle is controlled to drive or stop according to the above-mentioned preset control and display strategies, and the display content of the external display device of the vehicle is changed accordingly.

[0104] In one embodiment, the external display device includes at least one of an auditory display device and a visual display device;

[0105] If the external display device includes an auditory display device, the display method of the first display information and / or the second display information includes sound display;

[0106] If the external display device includes a visual display device, the display method of the first display information and / or the second display information includes at least one of light display, text display, graphic display and symbol display.

[0107] In one embodiment, the first display information is also used to display the current driving speed of the vehicle.

[0108] In an embodiment, if the target existence state includes not existing, the control and display strategy includes:

[0109] Obtain the road conditions ahead of the vehicle;

[0110] If the road condition ahead includes a crosswalk or an intersection, the external display device of the vehicle is controlled to display first display information, where the first display information is used to indicate that the vehicle is passing.

[0111] It should be noted that the target object in the above embodiments may be an object pre-set by those skilled in the art, such as pedestrians and animals.

[0112] The method provided in the above embodiment perceives the environment in real time during the driving process of the vehicle. When the vehicle passes through an intersection or a road where pedestrians may cross, the vehicle slows down in advance and determines whether there are pedestrians (target objects) ahead. If there are pedestrians on the road ahead, identification is performed in three situations: pedestrians are crossing the road (target objects are crossing the road), pedestrians are waiting to cross the road at the intersection (waiting to cross the road), and pedestrians have no intention of crossing the road at the intersection (no intention of crossing the road). The driving state of the vehicle is determined based on the results of environmental perception. If there are no pedestrians on the road ahead, the vehicle maintains the current speed; if there are pedestrians crossing the road on the road ahead, the vehicle brakes to a stop; if there are pedestrians waiting to cross the road at the intersection, the vehicle brakes to a stop; if there are pedestrians waiting to cross the road at the intersection, the vehicle slows down to pass; based on the driving state of the vehicle, the corresponding driving state is presented to pedestrians in the form of human-computer interaction information, that is, the first display information or the second display information is displayed through the external display device.

[0113] For an exemplary example, see Figure 4 , Figure 4 FIG. 1 is a schematic diagram of a display process of the first display information or the second display information shown in an exemplary embodiment of the present application. Figure 4 As shown, displaying the first display information or the second display information through the external display device includes:

[0114] If there are no pedestrians on the road ahead, the vehicle will maintain the current speed, display the vehicle's driving status through sound, light, graphics or symbols, and display the current speed of the car on the front of the vehicle; if there are pedestrians on the road ahead, but they have no intention of crossing the road, the vehicle will maintain the current speed, display the vehicle's driving status through sound, light, graphics or symbols, and display the current speed of the car on the front of the vehicle, to convey to pedestrians that the vehicle is passing normally at this time and will not stop to give way to pedestrians; if there are pedestrians crossing the road ahead, or pedestrians are waiting to cross the road at the intersection, the vehicle brakes to a stop, the front of the vehicle displays the parking information, and displays the vehicle giving way to pedestrians through sound, light, graphics or symbols. The vehicle determines which one or more display methods to use based on the pedestrian's passing action, that is, the target existence status and the road crossing status, and displays the first display information or the second display information.

[0115] It can be seen that the vehicle control method provided by the present application can enable at least one of the following interaction modes to exist between the vehicle and the target object:

[0116] Visual interaction, by installing a display device on the front of the vehicle to convey information to pedestrians through text, graphics and symbols (first display information);

[0117] Auditory interaction: by installing a speaker at the front end of the vehicle, voice outputs interactive information (second display information) to pedestrians.

[0118] See also Figure 5 , Figure 5 FIG. 1 is a flow chart of a vehicle control method according to an exemplary embodiment of the present application. Figure 5 As shown, taking the target object as a pedestrian as an example, the presence or absence of pedestrians is identified by transmitting the current environmental information to the vehicle's onboard terminal. The onboard terminal is provided with an environmental perception module to identify pedestrian information on the road. That is, the vehicle identification shown in the figure. The judgment of whether there are pedestrians may result in any of the following four results: whether there are pedestrians or not and whether there are pedestrians. When there are pedestrians, it is divided into the following three situations: pedestrians are crossing, pedestrians are waiting to cross, and pedestrians have no intention of crossing. For pedestrians walking on the crosswalk (pedestrians are crossing), the vehicle stops without affecting their normal passage, and displays the communication information of vehicles giving way to pedestrians. For pedestrians waiting to cross at the intersection (pedestrians waiting to cross), the vehicle stops and waits for their passage to complete, and displays the information of vehicles giving way to pedestrians. If the pedestrian continues to wait and does not cross the road for more than a certain period of time, the system determines that the pedestrian has no intention of crossing the road for the time being, and the system changes the driving state and displays the driving information to the pedestrian. For pedestrians who have no intention to cross the road at the intersection, the vehicle receives the pedestrian's intention to cross the road in real time, passes slowly and displays the driving status in real time. When the vehicle stops to wait for pedestrians to pass, it stops to wait for pedestrians to pass and then exits the current control and display strategy.

[0119] In other words, in the above-mentioned embodiment, if there are no pedestrians on the road ahead, the vehicle maintains the current speed and displays the vehicle's driving status through sounds, lights, graphics or symbols, while the current speed of the car is displayed on the front of the vehicle; if there are pedestrians on the road ahead but they have no intention of crossing the road, the vehicle maintains the current speed and displays the vehicle's driving status through sounds, lights, graphics or symbols, while the current speed of the car is displayed on the front of the vehicle, to convey to the pedestrians that the vehicle is passing normally at this time and will not stop to give way to pedestrians; if there are pedestrians crossing the road ahead, or there are pedestrians waiting to cross the road at the intersection, the vehicle brakes to a stop, and the front of the vehicle displays parking information, and sounds, lights, graphics or symbols are used to show that the vehicle is giving way to pedestrians.

[0120] In one embodiment, after determining the control and display strategy of the vehicle based on at least one of the target presence state and the road travel state, the method further includes:

[0121] Determine display information based on control and display strategies;

[0122] The external display device is controlled to display the first display information or the second display information based on the display signal.

[0123] Corresponding display information is pre-configured for different display strategies, such as what color of light to use or what text content to display.

[0124] The vehicle control method provided in the above embodiment obtains the current environmental information of the vehicle, performs target detection on the current environmental information, and obtains the target existence status of the target object. If the target existence status is existence, the road position information of the target object is determined according to the current environmental information to determine the road travel status of the target object. The vehicle control and display strategy is determined based on at least one of the target existence status and the road travel status, and the vehicle is controlled according to the control and display strategy. The current driving status and driving intention of the vehicle can be transmitted to pedestrians in a timely manner so that pedestrians can understand the driving intention of the vehicle in a timely manner, thereby further improving the driving safety of the vehicle and improving the customer experience.

[0125] Figure 6 is a block diagram of a vehicle control device shown in an exemplary embodiment of the present application. The device can be applied to Figure 1 The implementation environment shown in the figure is specifically configured in a server or a vehicle-mounted terminal. The device can also be applied to other exemplary implementation environments and specifically configured in other devices. This embodiment does not limit the implementation environment to which the device is applied.

[0126] like Figure 6 As shown, the exemplary vehicle control device 600 includes:

[0127] An acquisition module 601 is used to acquire current environment information of the vehicle, where the current environment information includes at least one of a current road surface image, a current roadside image, current road surface radar data, and current roadside radar data;

[0128] The target detection module 602 is used to perform target detection on the current environment information to obtain the target existence state of the target object;

[0129] A state determination module 603 is used to determine the road position information of the target object according to the current environment information if the target existence state is existence, so as to determine the road travel state of the target object;

[0130] The control module 604 is used to determine the control and display strategy of the vehicle based on at least one of the target existence state and the road traveling state, and control the vehicle according to the control and display strategy.

[0131] Figure 7 FIG. 1 is a block diagram of a vehicle control device shown in another exemplary embodiment of the present application. Figure 7 As shown, the device comprises:

[0132] Environmental perception module (i.e. Figure 6The acquisition module, target detection module and state determination module in the vehicle are used to perceive the environment in real time during the vehicle driving process, including intersection information, traffic signal information, and pedestrian information on the road;

[0133] Vehicle driving decision module (i.e. Figure 6 The control module in the vehicle is used to determine the driving state of the vehicle according to the results of environmental perception: if there are no pedestrians on the road ahead, the vehicle maintains the current speed; if there are pedestrians crossing the road ahead, the vehicle brakes to a stop; if there are pedestrians waiting to cross the road at the intersection, the vehicle brakes to a stop; if the pedestrians have no intention of crossing the road at the intersection, the vehicle slows down and passes;

[0134] A human-machine interaction information presentation control module is used to timely control the interactive information conveyed to pedestrians according to the signal of the vehicle driving decision module;

[0135] The human-computer interaction information presentation module (ie, the external display device) is used to present the corresponding driving status to pedestrians in the form of human-computer interaction information according to the signal input from the human-computer interaction information presentation control module.

[0136] It should be noted that the vehicle control device provided in the above embodiment is different from the vehicle control device provided in the above embodiment. Figure 2 The vehicle control method provided belongs to the same concept, and the specific manner in which each module and unit performs the operation has been described in detail in the method embodiment, which will not be repeated here. In practical applications, the vehicle control device provided in the above embodiment can distribute the above functions to different functional modules as needed, that is, divide the internal structure of the device into different functional modules to complete all or part of the functions described above, and this is not limited here.

[0137] An embodiment of the present application also provides an electronic device, comprising: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the electronic device implements the vehicle control method provided in the above-mentioned embodiments.

[0138] Figure 8 The structure diagram of the computer system suitable for implementing the electronic device of the embodiment of the present application is shown. It should be noted that: Figure 8 The computer system 1100 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0139] like Figure 8As shown, the computer system 1100 includes a central processing unit (CPU) 1101, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1102 or the program loaded from the storage part 1108 to the random access memory (RAM) 1103, such as executing the method described in the above embodiment. In the RAM 1103, various programs and data required for system operation are also stored. The CPU 1101, the ROM 1102 and the RAM 1103 are connected to each other via a bus 1104. An input / output (I / O) interface 1105 is also connected to the bus 1104.

[0140] The following components are connected to the I / O interface 1105: an input section 1106 including a keyboard, a mouse, etc.; an output section 1107 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1108 including a hard disk, etc.; and a communication section 1109 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1109 performs communication processing via a network such as the Internet. A drive 1110 is also connected to the I / O interface 1105 as needed. A removable medium 1111, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1110 as needed so that a computer program read therefrom is installed into the storage section 1108 as needed.

[0141] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 1109, and / or installed from a removable medium 1111. When the computer program is executed by a central processing unit (CPU) 1101, various functions defined in the system of the present application are executed.

[0142] It should be noted that the computer-readable medium shown in the embodiment of the present application can be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium can be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. This propagated data signal can take a variety of forms, including but not limited to an electromagnetic signal, an optical signal, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. A computer program contained on a computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0143] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0144] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0145] Another aspect of the present application further provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor of a computer, the computer executes the vehicle control method as described above. The computer-readable storage medium may be included in the electronic device described in the above embodiment, or may exist independently without being assembled into the electronic device.

[0146] Another aspect of the present application also provides a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the vehicle control method provided in each of the above embodiments.

[0147] The above embodiments are merely illustrative of the principles and effects of the present invention, and are not intended to limit the present invention. Anyone familiar with the technology may modify or change the above embodiments without violating the spirit and scope of the present invention. Therefore, all equivalent modifications or changes made by a person of ordinary skill in the art without departing from the spirit and technical ideas disclosed by the present invention shall still be covered by the claims of the present invention.

Claims

1. A vehicle control method, characterized in that: The method comprises: Acquire current environment information of the vehicle, the current environment information including at least one of a current road surface image, a current roadside image, current road surface radar data, and current roadside radar data; Performing target detection on the current environment information to obtain a target existence state of a target object; If the target existence status is existence, the road position information of the target object is determined according to the current environment information to determine the road traveling status of the target object, wherein if the target existence status is existence, the road position information of the target object is determined according to the current environment information to determine the road traveling status of the target object, including: determining the road position information of the target object according to the current environment information, the road position information including roadside or middle of the road; if the road position information is roadside, acquiring historical information, determining the road traveling status of the target object according to the historical information and the road position information, the historical information including at least one of historical road surface images, historical roadside images, historical road surface radar data, and historical roadside radar data, determining the road traveling status of the target object according to the historical information and the road position information includes: determining the historical position information of the target object according to the historical information, the historical position information including roadside or middle of the road; if the historical position information is different from the road position information, determining the road traveling status as no intention to cross the road; if the historical position information is the same as the road position information, determining the road traveling status as waiting to cross the road; A control and display strategy for the vehicle is determined based on at least one of the target existence state and the road traveling state, and the vehicle is controlled according to the control and display strategy.

2. The vehicle control method according to claim 1, characterized in that: The method further comprises at least one of the following: If the road crossing state is determined to be no intention to cross the road, the control and display strategy includes controlling the vehicle to drive slowly, and controlling the external display device of the vehicle to display first display information, wherein the first display information is used to indicate that the vehicle is passing; If the road crossing state is determined to be waiting to cross the road, the control and display strategy includes controlling the vehicle to stop, and controlling the external display device of the vehicle to display second display information, wherein the second display information is used to indicate that the vehicle is in a stopped state and the target object is requested to pass; If the road position information is in the middle of the road, the road traveling status includes that the target object is traveling on the road surface, and the control and display strategy includes controlling the vehicle to stop, and controlling the external display device of the vehicle to display the second display information.

3. The vehicle control method according to claim 2, characterized in that: If the road crossing state is determined to be waiting to cross the road, the method further includes: Monitoring the road travel status of the target object; If the road crossing state is waiting to cross the road, and the duration of the road crossing state is greater than the preset duration threshold, the road crossing state is updated to no intention to cross the road; The control and display strategy includes controlling the vehicle to drive slowly, and controlling an external display device of the vehicle to display the first display information.

4. The vehicle control method according to any one of claims 2 or 3, characterized in that: The external display device includes at least one of an auditory display device and a visual display device; If the external display device includes an auditory display device, the display method of the first display information and / or the second display information includes sound display; If the external display device includes a visual display device, the display method of the first display information and / or the second display information includes at least one of light display, text display, graphic display and symbol display.

5. The vehicle control method according to any one of claims 2 or 3, characterized in that: The first display information is also used to display the current driving speed of the vehicle.

6. The vehicle control method according to any one of claims 1 to 3, characterized in that: If the target existence state includes non-existence, the control and display strategy includes: Obtaining road conditions ahead of the vehicle; If the road condition ahead includes a crosswalk or an intersection, the external display device of the vehicle is controlled to display first display information, where the first display information is used to indicate that the vehicle is passing.

7. A vehicle control device, characterized in that: Applied to the vehicle control method according to any one of claims 1 to 6, the device comprises: An acquisition module, used to acquire current environmental information of the vehicle, wherein the current environmental information includes at least one of a current road surface image, a current roadside image, current road surface radar data, and current roadside radar data; A target detection module is used to perform target detection on the current environment information to obtain the target existence state of the target object; A state determination module, configured to determine the road position information of the target object according to the current environment information if the target existence state is existence, so as to determine the road travel state of the target object; A control module is used to determine a control and display strategy for the vehicle based on at least one of the target existence state and the road traveling state, and control the vehicle according to the control and display strategy.

8. An electronic device, characterized in that: The electronic device comprises: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the electronic device to implement the method as claimed in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Forecasting method and system for pedestrian crossing road based on HMM algorithm

    CN109063642A

  • Pedestrian road-crossing intention recognition method based on gaze detection and traffic scene recognition

    CN112329684A

  • Vehicle control method and device, equipment and medium

    CN112519765A

  • Traffic right decision-making method for automatic driving automobile in facing pedestrians

    CN112622937A

  • Automatic driving method, related equipment and computer readable storage medium

    CN113128303A