Human-computer interaction method, device, electronic equipment, vehicle and medium for locking and following a vehicle

Abstract

The present application provides a human-computer interaction method, device, electronic device, vehicle and medium for locking and following a vehicle, the method comprising: acquiring real-time perception data of the vehicle's surrounding environment, generating and displaying other vehicle identifications corresponding to other vehicles in the surrounding environment on the intelligent driving perception screen of the vehicle according to the real-time perception data; the other vehicle identifications include a locking and following vehicle touch identification for indicating that the vehicle is locked and following the other vehicle relative to the other vehicle; real-time detection of touch operations received by the locking and following vehicle touch identification, determining the other vehicle corresponding to the touched locking and following vehicle touch identification as a target vehicle, and generating a control instruction for the vehicle to lock and follow the target vehicle relative to the target vehicle; and controlling whether the vehicle locks and follows the target vehicle according to the control instruction according to the vehicle attributes and real-time vehicle information of the target vehicle. The human-computer interaction method for locking and following a vehicle provided by the present application improves the personalization of the intelligent driving system while ensuring driving safety, thereby improving the user experience of autonomous driving.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a human-computer interaction method, device, electronic device, vehicle and storage medium for locking and following a vehicle. Background Art

[0002] In recent years, with the development of intelligent driving technology, more and more vehicles on the market have automatic driving functions. The realization of automatic driving functions depends on the vehicle's Advanced Driver Assistance System (ADAS). After the vehicle starts automatic driving, the Advanced Driver Assistance System can obtain real-time data about the vehicle's environment and make judgments based on preset intelligent driving strategies, and control the vehicle to follow traffic rules and drive safely to the destination along the planned route.

[0003] However, in the related technologies, most of the autonomous driving driving modes are preset. If the advanced driving assistance system controls the vehicle to drive according to the preset driving mode, the user will not be able to control the vehicle to drive according to his or her own driving habits.

[0004] Therefore, it is necessary to provide a technical solution to solve the above technical problems. Summary of the invention

[0005] The present application provides a human-computer interaction method, device, electronic device, vehicle and storage medium for locking and following a vehicle, which can control a vehicle to lock and follow a vehicle specified by a user.

[0006] In a first aspect, the present application provides a human-computer interaction method for locking a following vehicle, comprising:

[0007] Acquire real-time perception data of the surrounding environment of the vehicle, and generate and display the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle according to the real-time perception data; wherein the other vehicle identification includes a lock-follow-vehicle touch identification, and the lock-follow-vehicle touch identification is used to indicate the real-time vehicle control mode of the own vehicle locking and following the other vehicle relative to the other vehicle;

[0008] Real-time detection of the touch operation received by the locking and following vehicle touch mark, determining the other vehicle corresponding to the locked and following vehicle touch mark as a target vehicle, and generating a control instruction for the self-vehicle to lock and follow the target vehicle;

[0009] According to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the self-vehicle is controlled to lock and follow the target vehicle according to the control instruction.

[0010] Optionally, the other vehicle identification includes an other vehicle touch identification, and the other vehicle touch identification is used to indicate the real-time vehicle information;

[0011] The generating and displaying the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle includes:

[0012] Generate and display the other vehicle touch identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle, and detect the touch operation received by the other vehicle touch identification in real time;

[0013] If the touch operation received by the other vehicle touch indicator is a touch operation for selecting a vehicle control mode, then a vehicle control indicator including the lock and follow vehicle touch indicator is displayed; wherein the vehicle control indicator is used to indicate the real-time vehicle control mode of the own vehicle relative to the other vehicle;

[0014] The real-time detection of the touch operation received by the locking and following vehicle touch mark, determining the other vehicle corresponding to the touched locking and following vehicle touch mark as a target vehicle, and generating a control instruction for the self-vehicle to lock and follow the target vehicle, includes:

[0015] Determine the other vehicle corresponding to the touched other vehicle touch mark as the target vehicle;

[0016] If it is detected that the locking and following vehicle touch mark is touched, a control instruction for the ego vehicle to lock and follow the target vehicle is generated.

[0017] Optionally, after controlling whether the self-vehicle locks and follows the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for locking and following the vehicle further includes:

[0018] If the self-vehicle is controlled to lock and follow the target vehicle, when the other vehicle identification corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, the target vehicle is searched from the other vehicles according to the vehicle attributes;

[0019] If the target vehicle is found, the self-vehicle is controlled to continue to lock and follow the target vehicle;

[0020] If the target vehicle cannot be searched, the user is notified that locking and following the target vehicle has failed.

[0021] Optionally, the vehicle attributes include standard attributes of the vehicle when it leaves the factory;

[0022] The step of searching for the target vehicle from the other vehicles according to the vehicle attributes includes:

[0023] Obtaining some standard attributes of the target vehicle scene;

[0024] According to the partial standard attributes, matching and acquiring all standard attributes of the target vehicle from a pre-established database;

[0025] According to all the standard attributes, the target vehicle is searched from the other vehicles.

[0026] Optionally, the vehicle attributes include non-standard attributes of the vehicle after it leaves the factory;

[0027] The step of searching for the target vehicle from the other vehicles according to the vehicle attributes includes:

[0028] Obtaining non-standard attributes of the target vehicle;

[0029] According to the non-standard attribute, a vehicle having the same non-standard attribute is searched from the other vehicles and confirmed as the target vehicle.

[0030] Optionally, after controlling whether the self-vehicle locks and follows the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for locking and following the vehicle further includes:

[0031] If the self-vehicle is controlled to lock and follow the target vehicle, when the other vehicle logo corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, the target vehicle is requested to share location information;

[0032] The position information shared by the target vehicle is received, and according to the position information shared by the target vehicle, the self-vehicle is controlled to re-lock and follow the target vehicle.

[0033] Optionally, after controlling whether the self-vehicle locks and follows the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for locking and following the vehicle further includes:

[0034] Displaying an unlock touch indicator and / or a maintain lock touch indicator; wherein the unlock touch indicator is used to indicate that the vehicle is unlocked and follows the target vehicle, and the maintain lock touch indicator is used to indicate that the vehicle is maintained locked and follows the target vehicle;

[0035] If it is detected that the unlocking touch mark is touched, the self-vehicle is controlled to unlock and follow the target vehicle;

[0036] If it is detected that the maintain lock touch mark is touched, the self-vehicle is controlled to maintain lock and follow the target vehicle.

[0037] In a second aspect, the present application provides a human-machine interaction device for locking a following vehicle, comprising:

[0038] A display module is used to obtain real-time perception data of the surrounding environment of the vehicle, and based on the real-time perception data, generate and display the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle; wherein the other vehicle identification includes a lock-follow vehicle touch identification, and the lock-follow vehicle touch identification is used to indicate the real-time vehicle control mode of the own vehicle locking and following the other vehicle;

[0039] A touch module is used to detect the touch operation received by the locking and following vehicle touch mark in real time, determine the other vehicle corresponding to the locked and following vehicle touch mark touched as a target vehicle, and generate a control instruction for the self-vehicle to lock and follow the target vehicle;

[0040] The control module is used to control whether the self-vehicle locks and follows the target vehicle according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment.

[0041] In a third aspect, the present application provides an electronic device comprising at least one processor, wherein the processor is used to implement the human-computer interaction method for locking and following a vehicle as described in any one of the first aspects.

[0042] In a fourth aspect, the present application provides a vehicle comprising at least one processor, wherein the processor is used to implement the human-computer interaction method for locking and following a vehicle as described in any one of the first aspects.

[0043] In a fifth aspect, the present application provides a computer-readable storage medium having a program stored thereon, and when the program is executed by a processor, the human-computer interaction method for locking and following a vehicle as described in any one of the first aspects is implemented.

[0044] In the human-computer interaction method, device, electronic device, vehicle and storage medium for locking and following a vehicle provided by the present application, a locking and following vehicle touch mark corresponding to other vehicles in the surrounding environment of the own vehicle is generated and displayed on the intelligent driving perception screen of the vehicle, and the user's touch operation is detected in real time, the target vehicle is determined according to the touch operation, and the own vehicle is controlled to lock and follow the target vehicle. Thus, a touch interaction method between the user and the intelligent driving system is provided, so that the user can request the intelligent driving system to control the own vehicle to lock and follow the vehicle specified by the user through touch interaction. In addition, before controlling the own vehicle to lock and follow the target vehicle, the real-time vehicle information indicated by the other vehicle mark is also comprehensively considered, which improves the personalization of the intelligent driving system while ensuring driving safety, thereby improving the user experience of autonomous driving. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0046] Figure 1 The figure is a schematic diagram of a scenario to which the human-computer interaction method for locking and following a vehicle according to an embodiment of the present application is applicable.

[0047] Figure 2 The figure is a flow chart of the human-computer interaction method for locking and following a vehicle according to an embodiment of the present application.

[0048] Figure 3 Shown is a schematic diagram of an electronic image according to an embodiment of the present application.

[0049] Figure 4 The figure shows a structural block diagram of a human-computer interaction device for locking and following a vehicle according to an embodiment of the present application.

[0050] Figure 5 Shown is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0051] Here, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements.

[0052] The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with one or more embodiments of this specification. Instead, they are merely examples of devices and methods consistent with some aspects of one or more embodiments of this specification as detailed in the attached claims. It should be noted that in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the steps included in the method may be more or less than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; and multiple steps described in this specification may be combined into a single step for description in other embodiments.

[0053] In the related art, in vehicles with autonomous driving functions, the advanced driving assistance system usually controls the vehicle to drive according to a preset driving mode, making it impossible for users to control the vehicle to drive according to their own wishes.

[0054] In order to solve the technical problem in the related art that the user cannot control the vehicle to drive as he or she wishes when the vehicle is automatically driving, the embodiment of the present application provides a human-computer interaction method for locking and following the vehicle, by generating and displaying the locking and following vehicle touch logo corresponding to other vehicles in the surrounding environment of the vehicle on the vehicle's intelligent driving perception screen, and detecting the user's touch operation in real time, determining the target vehicle according to the touch operation, and controlling the vehicle to lock and follow the target vehicle, thereby providing a touch interaction method between the user and the intelligent driving system, so that the user can request the intelligent driving system to control the vehicle to lock and follow the vehicle specified by him or her through touch interaction.

[0055] In addition, in the related art, if the driving mode preset by the advanced driving assistance system does not conform to the user's driving habits, the user wants to drive the vehicle as he wishes, and needs to take over the vehicle from the advanced driving assistance system. The advanced driving assistance system exits the control of the vehicle, and the user drives the vehicle as the driver. In other words, when the vehicle is driving, the vehicle is either completely controlled by the advanced driving assistance system or completely driven by the user, which results in inflexible control methods for manual driving and automatic driving, and poor user experience of automatic driving. For example, when the advanced driving assistance system controls the vehicle, the user wants to lock and follow a certain vehicle, but the advanced driving assistance system cannot determine the target vehicle that the user wants to lock and follow.

[0056] In order to solve the technical problem of inflexible control modes of manual driving and automatic driving in related technologies, the embodiment of the present application provides a human-machine interaction method for locking and following a vehicle, which comprehensively considers the real-time vehicle information indicated by the other vehicle logo before controlling the self-vehicle to lock and follow the target vehicle. Through the user performing touch operations and the intelligent driving system detecting the touch operations in real time, the user and the intelligent driving system cooperate with each other, making the control modes of manual driving and automatic driving more flexible, and ensuring driving safety while improving the personalization of the intelligent driving system, thereby improving the user experience of automatic driving.

[0057] See also Figure 1 , Figure 1 The following is a schematic diagram of a scenario in which the human-computer interaction method for locking and following a vehicle according to an embodiment of the present application is applicable. The human-computer interaction method for locking and following a vehicle provided in an embodiment of the present application can be applied to a vehicle 10 having an intelligent driving system. The vehicle 10 may include a touch screen 11 and an electronic device connected to the touch screen 11. The electronic device may be, but is not limited to, a controller or a processor. The controller may include, but is not limited to, a body controller, a domain controller, and other devices, which are not listed one by one here. It should be noted that the vehicle 10 may also include Figure 1 For the introduction of other components not shown in the figure, please refer to the relevant description in the automotive field, which will not be described in detail here.

[0058] Please also read Figure 2 , Figure 2 The flowchart of the human-computer interaction method for locking and following a vehicle according to an embodiment of the present application is shown. The human-computer interaction method for locking and following a vehicle provided by the embodiment of the present application includes but is not limited to the following steps S101 to S103.

[0059] S101, obtaining real-time perception data of the vehicle's surrounding environment, and generating and displaying other vehicle identification corresponding to other vehicles in the surrounding environment on the intelligent driving perception screen of the own vehicle based on the real-time perception data; wherein the other vehicle identification includes a lock-follow vehicle touch identification, and the lock-follow vehicle touch identification is used to indicate the real-time vehicle control mode of the own vehicle locking and following the other vehicle relative to the own vehicle.

[0060] The intelligent driving system can sense the surrounding environment of the vehicle in real time during driving through various sensors installed on the vehicle (such as millimeter wave radar, laser radar, single / binocular camera and satellite navigation, etc.), obtain real-time perception data of the surrounding environment of the vehicle, and identify, detect and track static and dynamic objects based on the real-time perception data. In order to show the user the surrounding environment of the vehicle and facilitate the user to grasp the information of the surrounding environment of the vehicle in real time, the intelligent driving system can generate and display an electronic image of the surrounding environment of the vehicle on the Advanced Driver Assistance System View (ADV) of the vehicle.

[0061] The electronic image may include a vehicle identification and a lane identification. Among them: the vehicle identification is an identification corresponding to a vehicle in the surrounding environment of the own vehicle, which may include a vehicle identification corresponding to the own vehicle and an other vehicle identification corresponding to another vehicle, which is used to indicate real-time vehicle information in the surrounding environment; the lane identification is an identification corresponding to a lane in the surrounding environment of the own vehicle, which may include an identification corresponding to the own lane where the own vehicle is located and an identification corresponding to another lane where the own vehicle is not located, which is used to indicate real-time lane information in the surrounding environment. In some embodiments, the electronic image may also only include the own vehicle identification and the other vehicle identification but not the lane identification. The embodiment of the present application does not limit the specific types of perceived objects in the surrounding environment of the own vehicle contained in the electronic image.

[0062] Please also read Figure 3 , Figure 3 The electronic image of the embodiment of the present application is shown as a schematic diagram. The electronic image includes the vehicle identification, the other vehicle identification and the lane identification. The other vehicle identification may include the other vehicle graphic and / or the other vehicle number. The lane identification may include the lane graphic and / or the lane number. Figure 3 The electronic images shown are described in detail.

[0063] Lane markings include lane graphics and lane numbers ①, ②, ③ and ④. Among them: a solid line and a dotted line in the longitudinal direction constitute the lane graphics of the rightmost lane (lane ①) in the same direction, two dotted lines in the longitudinal direction constitute the lane graphics of the middle lane (lane ②) in the same direction, a dotted line and a solid line in the longitudinal direction constitute the lane graphics of the leftmost lane (lane ③) in the same direction, and a dotted line and a solid line in the longitudinal direction constitute the lane graphics of the leftmost lane (lane ④) in the opposite direction.

[0064] The other vehicle identification includes the other vehicle graphic and the other vehicle number A, B, C, D. Among them: Vehicle A, Vehicle B and Vehicle C are vehicles traveling in the same direction in lane ①, lane ② and lane ③ respectively, and Vehicle D is a vehicle traveling in the opposite direction in lane ④.

[0065] Setting the vehicle identification as a touchable identification forms a vehicle touch identification. The vehicle touch identification may include the vehicle touch identification and / or the other vehicle touch identification. Compared with the vehicle identification, the vehicle touch identification can be used to indicate the real-time vehicle information in the surrounding environment of the vehicle, and can also be used to receive the user's touch operation. The user can specify the vehicle by touching the vehicle touch identification in the electronic image.

[0066] In some embodiments, the other vehicle logo is a non-touchable logo. The intelligent driving system determines the other vehicle that the current self-vehicle can lock and follow based on the real-time vehicle information and the preset intelligent driving strategy, and displays a lock and follow vehicle touch logo around the other vehicle logo corresponding to the other vehicle that the current self-vehicle can lock and follow. Figure 3 In the electronic image shown: the current vehicle cannot lock and follow vehicle A or vehicle D, so the lock and follow touch icon is not displayed around the other vehicle icons corresponding to vehicles A and D; the current vehicle can lock and follow vehicle B or vehicle C, so the lock and follow touch icon is displayed around the other vehicle icons corresponding to vehicles B and C.

[0067] In other embodiments, the other vehicle logo is a touchable logo. The intelligent driving system does not directly display the lock-follow-vehicle touch logo around the other vehicle logo, but displays the lock-follow-vehicle touch logo around the other vehicle logo after detecting that the other vehicle logo is touched and the touch operation received by the other vehicle logo meets the conditions for displaying the vehicle control mode.

[0068] It should be noted that the display mode of the other vehicle logo and the lock-on-follow vehicle touch control logo in the electronic image is not limited to Figure 3As shown, the lock-follow-car touch indicator does not necessarily need to be displayed around the corresponding other car indicator, nor does it necessarily need to be displayed on the corresponding other car indicator. It is only necessary to establish a connection between the lock-follow-car touch indicator and its corresponding other car indicator, and display this connection in the electronic image. For example, different other car indicators can also be set to different colors, and the lock-follow-car touch indicator can be set to the same color as the corresponding other car indicator. The specific display method of the other car indicator and the lock-follow-car touch indicator is not limited in the embodiment of the present application.

[0069] It should be noted that Figure 3 In the electronic image shown, the vehicle logo is black, the other vehicle logos of cars B and C are white, the other vehicle logos of cars A and D are gray, the lane graphics of lanes ①, ②, and ③ are white, and the lane graphics of lane ④ is gray ( Figure 3 ) Wherein: a white other vehicle logo indicates that the current self-vehicle can perform at least one vehicle control method (such as overtaking or following) relative to the other vehicle represented by the other vehicle logo, and a gray other vehicle logo indicates that the current self-vehicle cannot perform any vehicle control method relative to the other vehicle represented by the other vehicle logo; similarly, a white lane graphic indicates that the current self-vehicle can perform at least one lane control method (such as changing lanes) relative to the lane represented by the lane graphic, and a gray lane graphic indicates that the current self-vehicle cannot perform any lane control method relative to the lane represented by the lane graphic. In a specific scenario, the colors of the other vehicle logos corresponding to different other vehicles and the lane graphics corresponding to different lanes can be specifically set, and the colors of the lane numbers corresponding to different lanes can also be different. For example, the self-vehicle logo can be set to the real color of the self-vehicle, the other vehicle logo on which at least one vehicle control method can be performed can be set to green, and the other vehicle logo on which no vehicle control method can be performed can be set to red. The embodiment of the present application does not limit the specific colors of different lane logos, different other vehicle logos, and self-vehicle logos.

[0070] S102, detecting the touch operation received by the lock and follow vehicle touch mark in real time, determining the other vehicle corresponding to the touched lock and follow vehicle touch mark as a target vehicle, and generating a control instruction for the own vehicle to lock and follow the target vehicle.

[0071] When the user performs a touch operation on the lock-follow-car touch indicator, the lock-follow-car touch indicator will receive the touch operation. However, because in general, the user will only specify one other car, only one lock-follow-car touch indicator will receive the touch operation. Among them, the other car corresponding to the lock-follow-car touch indicator that receives the touch operation is the vehicle specified by the user, that is, the target vehicle.

[0072] After the lock-and-follow touch indicator corresponding to the target vehicle receives a touch operation, the intelligent driving system needs to generate a control instruction for the vehicle to lock and follow the target vehicle in response to the user's touch operation, so as to facilitate subsequent control of the vehicle to lock and follow the target vehicle.

[0073] S103, according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, controlling whether the vehicle locks and follows the target vehicle according to the control instruction.

[0074] Each vehicle has different vehicle attributes, such as brand, model, outline, color, and license plate number. Based on the real-time perception data of the vehicle's surrounding environment, the intelligent driving system can obtain the vehicle attributes of other vehicles in the surrounding environment in real time, and lock the target vehicle based on the vehicle attributes of other vehicles.

[0075] After locking the target vehicle, the intelligent driving system needs to determine whether the real-time road conditions are safe based on the real-time vehicle information before deciding whether to control the vehicle to follow the control instructions. If the real-time vehicle information does not allow it, the intelligent driving system will not control the vehicle to follow the control instructions. Figure 3 In the electronic image shown, if the target vehicle is car B, to control the own vehicle to lock onto and follow car B, it is necessary to control the own vehicle to change lanes to the lane where car B is located first. At this time, there is another car running parallel to the own vehicle in the lane where car B is located. The real-time road condition is not safe, and the own vehicle cannot be controlled to change lanes to the lane where car B is located. The own vehicle needs to overtake the other car running parallel to the own vehicle behind car B before it can control the own vehicle to change lanes and drive behind car B.

[0076] In some embodiments, the other vehicle identification in the above steps includes the other vehicle touch identification, and the other vehicle touch identification is used to indicate the real-time vehicle information in the surrounding environment and receive touch operations;

[0077] In the above step S101, when generating and displaying the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle, the following steps are specifically included:

[0078] Generate and display the other vehicle touch identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle, and detect the touch operation received by the other vehicle touch identification in real time;

[0079] If the touch operation received by the other vehicle touch indicator is a touch operation for selecting a vehicle control mode, then the vehicle control indicators including the lock and follow vehicle touch indicator are displayed; wherein the vehicle control indicator is used to indicate the real-time vehicle control mode of the own vehicle relative to the other vehicle;

[0080] In the above step S102, the touch operation received by the lock and follow vehicle touch mark is detected in real time, the other vehicle corresponding to the touched lock and follow vehicle touch mark is determined as the target vehicle, and a control instruction for the self-vehicle to lock and follow the target vehicle is generated, which specifically includes the following steps:

[0081] The other vehicle corresponding to the touched other vehicle touch mark is determined as the target vehicle;

[0082] If it is detected that the lock and follow vehicle touch mark is touched, a control instruction for the self-vehicle to lock and follow the target vehicle is generated.

[0083] When the intelligent driving system generates and displays the electronic image of the surrounding environment of the self-vehicle, it first generates and displays the self-vehicle logo and the other-vehicle touch logo corresponding to the other-vehicle in the surrounding environment, then detects the touch operation received by the other-vehicle touch logo in real time, and finally generates and displays the vehicle control logo including the lock-follow-vehicle touch logo when the touch logo received by the other-vehicle touch logo is a touch operation for selecting the vehicle control mode. Among them, the other-vehicle touch logo is used to indicate the real-time vehicle information in the surrounding environment and receive the touch operation, the other vehicle corresponding to the other-vehicle touch logo that receives the touch operation is the target vehicle, and the lock-follow-vehicle touch logo is used to indicate the vehicle control mode of the self-vehicle locking the following vehicle relative to the target vehicle and receiving the touch operation.

[0084] In some embodiments, in the above step S103, when controlling whether the vehicle locks and follows the target vehicle according to the control instruction according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the following steps are specifically included:

[0085] Determine whether the real-time vehicle information complies with a safe intelligent driving strategy;

[0086] If yes, then according to the vehicle attributes of the target vehicle, the self-vehicle is controlled to lock and follow the target vehicle according to the control instruction;

[0087] If not, the vehicle is controlled to maintain the current state.

[0088] If the real-time vehicle information conforms to the safe intelligent driving strategy, it means that the current road conditions are safe. The vehicle attributes of the target vehicle can be directly used to control the vehicle to lock and follow the target vehicle according to the control instructions.

[0089] If the real-time vehicle information does not conform to the safe intelligent driving strategy, it means that the current road condition is unsafe and the vehicle needs to be controlled to maintain the current driving state, but the vehicle cannot be controlled to lock and follow the target vehicle according to the control instructions.

[0090] In some embodiments, after controlling whether the vehicle locks and follows the target vehicle according to the control instruction in step S103 according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for locking and following the vehicle in the embodiment of the present application further includes the following steps:

[0091] If the self-vehicle is controlled to lock and follow the target vehicle, when the other vehicle logo corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, the target vehicle is searched from other vehicles according to the attributes of the vehicle;

[0092] If the target vehicle is found, the vehicle is controlled to continue to lock onto and follow the target vehicle;

[0093] If the target vehicle cannot be found, the user is notified that the locking and following of the target vehicle has failed.

[0094] When controlling the self-vehicle to lock and follow the target vehicle, if the self-vehicle's intelligent driving screen displays the vehicle logo corresponding to the vehicle that has entered between the self-vehicle and the target vehicle, it means that there is another vehicle between the self-vehicle and the target vehicle. In order not to lose the target vehicle, it is necessary to search for the target vehicle from the surrounding vehicles of the self-vehicle based on the vehicle attributes of the target vehicle. If the target vehicle is found within the preset time, the target vehicle will continue to be locked and followed. If the target vehicle is not found, the user will be notified that the locking and following of the target vehicle has failed.

[0095] In some embodiments, the vehicle attributes include standard attributes of the vehicle when it leaves the factory, such as brand, model, outline, and color; in the above steps, searching for the target vehicle from other vehicles according to the vehicle attributes specifically includes the following steps:

[0096] Obtain some vehicle attributes of the target vehicle at the scene;

[0097] According to the partial vehicle attributes, matching and obtaining all vehicle attributes of the target vehicle from a pre-established database;

[0098] According to the attributes of all vehicles, the target vehicle is searched from other vehicles.

[0099] A brand of vehicle may have multiple models on the market, and different models of vehicles under the same brand have different outlines and colors. Therefore, a database can be pre-established based on the vehicle attribute data published by each brand, and the corresponding relationship between all vehicle attributes such as brand, logo, model, color, local outline and whole vehicle three-dimensional outline of different vehicles can be stored in the database, and the database can be stored in the cloud. After the intelligent driving system determines the target vehicle to be locked and followed, some vehicle attributes of the target vehicle on the scene (such as color and rear outline) are uploaded to the database. After matching all vehicle attributes of the target vehicle, other vehicle attributes of the target vehicle (such as brand, logo and whole vehicle three-dimensional outline) are received from the database, so as to facilitate the subsequent more accurate locking and following of the target vehicle, and to search for the target vehicle from the surrounding vehicles of the vehicle in more dimensions after other vehicles cut in.

[0100] In some embodiments, the vehicle attributes include non-standard attributes of the vehicle after it leaves the factory, such as a license plate number, decorations, personalized slogans, etc.; in the above steps, when searching for the target vehicle from other vehicles according to the vehicle attributes, the following steps are specifically included:

[0101] Obtaining the non-standard attribute of the target vehicle;

[0102] According to the non-standard attribute, the target vehicle having the same non-standard attribute is searched from other vehicles.

[0103] Although the standard attributes of vehicles of the same brand and model are the same when they are put on the road, the non-standard attributes after they are put on the road are different. In addition to the unique license plate number, some users will also paste decorations or special slogans corresponding to the images in their favorite literary and artistic works on the body of the car. For example, some users will paste stickers of their favorite characters in anime all over the body of the car, some users will fix some cartoon three-dimensional decorations on the roof or rear of the car, and some users will paste personalized slogans on the body of the car, such as "Pregnant woman / child inside", "Newbie / Intern" or "Veteran / Strength". These non-standard attributes are very eye-catching and not easy to be duplicated. When searching for the target vehicle from other cars around, it is easier to lock it, which increases the success rate and accuracy of locking the target vehicle and further improves the user experience.

[0104] In some embodiments, after the above step S103 controls whether the vehicle locks and follows the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for locking and following the vehicle in the embodiment of the present application further includes the following steps:

[0105] If the self-vehicle is controlled to lock and follow the target vehicle, when the other vehicle logo corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, the target vehicle is requested to share the location information;

[0106] Receive the location information shared by the target vehicle, and control the vehicle to re-lock and follow the target vehicle according to the location information shared by the target vehicle.

[0107] The ego vehicle and the target vehicle being locked and followed may be traveling together. Therefore, when another vehicle cuts in between the ego vehicle and the target vehicle, the ego vehicle can request the target vehicle to share its location information. After receiving the location information shared by the target vehicle, the target vehicle can be re-locked based on the location information of the target vehicle.

[0108] In some embodiments, after the above step S103 controls whether the vehicle locks and follows the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for locking and following the vehicle in the embodiment of the present application further includes the following steps:

[0109] Displaying an unlock touch mark and / or a maintain lock touch mark; wherein the unlock touch mark is used to indicate that the vehicle is temporarily unlocked and follows the target vehicle, and the maintain lock touch mark is used to indicate that the vehicle is maintained locked and follows the target vehicle;

[0110] If it is detected that the unlocking touch mark is touched, the self-vehicle is controlled to unlock and follow the target vehicle;

[0111] If it is detected that the maintain lock touch mark is touched, the self-vehicle is controlled to maintain lock and follow the target vehicle.

[0112] During the process of controlling the self-vehicle to lock and follow the target vehicle, the user may not want to continue to lock and follow the target vehicle. At this time, the intelligent driving system can display an unlock touch icon and / or a maintain lock touch icon on the intelligent driving perception screen of the self-vehicle, which are used to indicate that the self-vehicle temporarily unlocks and follows the target vehicle and that the self-vehicle maintains the lock and follows the target vehicle.

[0113] The user can perform a touch operation on the unlock touch mark or the maintain lock touch mark. If the unlock touch mark is detected to be touched, it means that the user does not want to continue to lock and follow the target vehicle, and the vehicle is controlled to unlock and follow the target vehicle. If the maintain lock touch mark is detected to be touched, it means that the user wants to continue to lock and follow the target vehicle, and the vehicle is controlled to continue to lock and follow the target vehicle.

[0114] The present application also provides a human-machine interaction device for locking a following vehicle. Figure 4 , Figure 4 The structure block diagram of the human-machine interaction device for locking and following a vehicle according to an embodiment of the present application is shown. The human-machine interaction device 21 for locking and following a vehicle according to an embodiment of the present application may include:

[0115] The display module 211 is used to obtain real-time perception data of the surrounding environment of the vehicle, and generate and display the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle according to the real-time perception data; wherein the other vehicle identification includes a lock-follow vehicle touch identification, and the lock-follow vehicle touch identification is used to indicate the real-time vehicle control mode of the own vehicle locking and following the other vehicle;

[0116] The touch module 212 is used to detect the touch operation received by the lock and follow vehicle touch mark in real time, determine the other vehicle corresponding to the touched lock and follow vehicle touch mark as the target vehicle, and generate a control instruction for the self-vehicle to lock and follow the target vehicle;

[0117] The control module 213 is used to control whether the vehicle locks and follows the target vehicle according to the control instruction according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment.

[0118] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and the same technical effect can be achieved, which will not be repeated here.

[0119] In some embodiments, the aforementioned other vehicle identification further includes another vehicle touch identification, and the other vehicle touch identification is used to indicate real-time vehicle information in the surrounding environment;

[0120] When the display module 211 generates and displays the other vehicle identification corresponding to the other vehicle in the surrounding environment on the smart driving perception screen of the own vehicle, it is specifically used to: generate and display the other vehicle touch identification corresponding to the other vehicle in the surrounding environment on the smart driving perception screen of the own vehicle, and detect the touch operation received by the other vehicle touch identification in real time; if the touch operation received by the other vehicle touch identification is a touch operation for selecting a vehicle control mode, then display the vehicle control identification including the locking and following vehicle touch identification; wherein, the vehicle control identification is used to indicate the real-time vehicle control mode of the own vehicle relative to the other vehicle;

[0121] The touch module 212 detects the touch operation received by the lock and follow vehicle touch logo in real time, determines the other vehicle corresponding to the touched lock and follow vehicle touch logo as the target vehicle, and generates a control instruction for the own vehicle to lock and follow the target vehicle. It is specifically used to: determine the other vehicle corresponding to the touched other vehicle touch logo as the target vehicle; if it is detected that the lock and follow vehicle touch logo is touched, generate a control instruction for the own vehicle to lock and follow the target vehicle.

[0122] In some embodiments, when the control module 213 controls whether the self-vehicle locks and follows the target vehicle according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, it is specifically used to: determine whether the real-time vehicle information complies with a safe intelligent driving strategy; if so, control the self-vehicle to lock and follow the target vehicle according to the control instruction according to the vehicle attributes of the target vehicle; if not, control the self-vehicle to maintain the current driving state.

[0123] In some embodiments, after controlling whether the own vehicle locks and follows the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the control module 213 is also used to: if the own vehicle is controlled to lock and follow the target vehicle, then when the other vehicle identification corresponding to the vehicle entering between the own vehicle and the target vehicle is displayed on the intelligent driving perception screen of the own vehicle, the target vehicle is searched from the other vehicles according to the vehicle attributes; if the target vehicle is found, the own vehicle is controlled to continue to lock and follow the target vehicle; if the target vehicle cannot be found, the user is notified that the locking and following of the target vehicle has failed.

[0124] In some embodiments, when searching for the target vehicle from other vehicles based on the vehicle attributes, the control module 213 is specifically used to: obtain partial vehicle attributes of the target vehicle at the scene; match and obtain all vehicle attributes of the target vehicle from a pre-established database based on the partial vehicle attributes; and search for the target vehicle from other vehicles based on the all vehicle attributes.

[0125] In some embodiments, after controlling whether the own vehicle locks and follows the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the control module 213 is also used to: if the own vehicle is controlled to lock and follow the target vehicle, when the other vehicle identification corresponding to the vehicle entering between the own vehicle and the target vehicle is displayed on the intelligent driving perception screen of the own vehicle, request the target vehicle to share location information; receive the location information shared by the target vehicle, and control the own vehicle to re-lock and follow the target vehicle based on the location information shared by the target vehicle.

[0126] In some embodiments, after the control module 213 controls whether the self-vehicle locks and follows the target vehicle according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, it is also used to: if the self-vehicle is controlled to lock and follow the target vehicle, an unlock touch icon and / or a maintain lock touch icon are displayed; wherein the unlock touch icon is used to indicate that the self-vehicle temporarily unlocks and follows the target vehicle, and the maintain lock touch icon is used to indicate that the self-vehicle remains locked and follows the target vehicle; if it is detected that the unlock touch icon is touched, the self-vehicle is controlled to unlock and follow the target vehicle; if it is detected that the maintain lock touch icon is touched, the self-vehicle is controlled to remain locked and follow the target vehicle.

[0127] The present application also provides an electronic device, which may include the above-mentioned human-machine interaction device 21 for locking and following a vehicle. Figure 5 , Figure 5 The electronic device 20 may include one or more processors 22, and the processor 22 is used to implement the above-mentioned human-computer interaction method for locking and following a vehicle.

[0128] In some embodiments, the electronic device 20 may include a computer-readable storage medium 23, which may store a program that can be called by the processor 22 and may include a non-volatile storage medium. In other embodiments, the electronic device 20 may also include a memory 24 and an interface 25. In other embodiments, the electronic device 20 may also include other hardware according to actual applications.

[0129] The computer-readable storage medium 23 provided in the embodiment of the present application stores a program thereon, and when the program is executed by the processor 22, it is used to implement the above-mentioned human-computer interaction method for locking and following the vehicle.

[0130] The present application may take the form of a computer program product implemented on one or more computer-readable storage media 23 (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code. The computer-readable storage medium 23 includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information can be a computer-readable instruction, a data structure, a module of a program, or other data. The computer-readable storage medium 23 includes but is not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassette, tape disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0131] The above description is only a preferred embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this specification should be included in the scope of protection of this specification.

[0132] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the phrase "includes a ..." defines an element, and does not exclude the presence of other identical elements in the process, method, commodity or device including the element.

Claims

1. A human-computer interaction method for locking a following vehicle, characterized in that: include: Acquire real-time perception data of the surrounding environment of the vehicle, and generate and display the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle according to the real-time perception data; wherein the other vehicle identification includes a lock-follow-vehicle touch identification, and the lock-follow-vehicle touch identification is used to indicate the real-time vehicle control mode of the own vehicle locking and following the other vehicle relative to the other vehicle; Real-time detection of the touch operation received by the locking and following vehicle touch mark, determining the other vehicle corresponding to the locked and following vehicle touch mark as a target vehicle, and generating a control instruction for the self-vehicle to lock and follow the target vehicle; According to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the self-vehicle is controlled to lock and follow the target vehicle according to the control instruction; wherein, The human-computer interaction method for locking the following vehicle also includes: If the self-vehicle is controlled to lock and follow the target vehicle, when the other vehicle identifier corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, the target vehicle is searched from the other vehicles according to the vehicle attributes, including: Acquire some standard attributes of the target vehicle at the scene; match and acquire all standard attributes of the target vehicle from a pre-established database according to the some standard attributes; and search for the target vehicle from the other vehicles according to the all standard attributes.

2. The human-computer interaction method for locking and following a vehicle according to claim 1, characterized in that: The other vehicle identification includes an other vehicle touch identification, and the other vehicle touch identification is used to indicate the real-time vehicle information; The generating and displaying the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle includes: Generate and display the other vehicle touch identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle, and detect the touch operation received by the other vehicle touch identification in real time; If the touch operation received by the other vehicle touch indicator is a touch operation for selecting a vehicle control mode, then a vehicle control indicator including the lock and follow vehicle touch indicator is displayed; wherein the vehicle control indicator is used to indicate the real-time vehicle control mode of the own vehicle relative to the other vehicle; The real-time detection of the touch operation received by the locking and following vehicle touch mark, determining the other vehicle corresponding to the touched locking and following vehicle touch mark as a target vehicle, and generating a control instruction for the self-vehicle to lock and follow the target vehicle, includes: Determine the other vehicle corresponding to the touched other vehicle touch mark as the target vehicle; If it is detected that the locking and following vehicle touch mark is touched, a control instruction for the ego vehicle to lock and follow the target vehicle is generated.

3. The human-computer interaction method for locking and following a vehicle according to claim 1, characterized in that: After the self-vehicle is controlled to follow the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for following the vehicle also includes: If the self-vehicle is controlled to lock and follow the target vehicle, when the other vehicle identification corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, the target vehicle is searched from the other vehicles according to the vehicle attributes; If the target vehicle is found, the self-vehicle is controlled to continue to lock and follow the target vehicle; If the target vehicle cannot be searched, the user is notified that locking and following the target vehicle has failed.

4. The human-computer interaction method for locking and following a vehicle according to claim 3, characterized in that: The vehicle attributes include non-standard attributes of the vehicle after it leaves the factory; The step of searching for the target vehicle from the other vehicles according to the vehicle attributes includes: Obtaining non-standard attributes of the target vehicle; According to the non-standard attribute, a vehicle having the same non-standard attribute is searched from the other vehicles and confirmed as the target vehicle.

5. The human-computer interaction method for locking and following a vehicle according to claim 1, characterized in that: After the self-vehicle is controlled to follow the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for following the vehicle also includes: If the self-vehicle is controlled to lock and follow the target vehicle, when the other vehicle logo corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, the target vehicle is requested to share location information; The position information shared by the target vehicle is received, and according to the position information shared by the target vehicle, the self-vehicle is controlled to re-lock and follow the target vehicle.

6. The human-computer interaction method for locking and following a vehicle according to claim 1, characterized in that: After the self-vehicle is controlled to follow the target vehicle according to the control instruction based on the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment, the human-computer interaction method for following the vehicle also includes: If the self-vehicle is controlled to lock and follow the target vehicle, an unlocking touch mark and / or a maintaining locking touch mark are displayed; wherein the unlocking touch mark is used to indicate that the self-vehicle is unlocked and follows the target vehicle, and the maintaining locking touch mark is used to indicate that the self-vehicle is maintained locked and follows the target vehicle; If it is detected that the unlocking touch mark is touched, the self-vehicle is controlled to unlock and follow the target vehicle; If it is detected that the maintain lock touch mark is touched, the self-vehicle is controlled to maintain lock and follow the target vehicle.

7. A human-machine interaction device for locking a following vehicle, characterized in that: include: A display module is used to obtain real-time perception data of the surrounding environment of the vehicle, and based on the real-time perception data, generate and display the other vehicle identification corresponding to the other vehicle in the surrounding environment on the intelligent driving perception screen of the own vehicle; wherein the other vehicle identification includes a lock-follow vehicle touch identification, and the lock-follow vehicle touch identification is used to indicate the real-time vehicle control mode of the own vehicle locking and following the other vehicle; A touch module is used to detect the touch operation received by the locking and following vehicle touch mark in real time, determine the other vehicle corresponding to the locked and following vehicle touch mark touched as a target vehicle, and generate a control instruction for the self-vehicle to lock and follow the target vehicle; A control module, used for controlling whether the self-vehicle locks and follows the target vehicle according to the vehicle attributes of the target vehicle and the real-time vehicle information in the surrounding environment; The human-machine interaction device for locking and following a vehicle further includes: the control module is further specifically used for controlling the self-vehicle to lock and follow the target vehicle, and when the other vehicle identification corresponding to the vehicle entering between the self-vehicle and the target vehicle is displayed on the intelligent driving perception screen of the self-vehicle, searching for the target vehicle from the other vehicles according to the vehicle attributes, including: Acquire some standard attributes of the target vehicle at the scene; match and acquire all standard attributes of the target vehicle from a pre-established database according to the some standard attributes; and search for the target vehicle from the other vehicles according to the all standard attributes.

8. An electronic device, characterized in that: It comprises one or more processors, and the processor is used to implement the human-computer interaction method for locking and following a vehicle as described in any one of claims 1 to 6.

9. A vehicle, characterized in that: It comprises one or more processors, and the processor is used to implement the human-computer interaction method for locking and following a vehicle as described in any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the human-computer interaction method for locking and following a vehicle as described in any one of claims 1 to 6 is implemented.

Images