Human-machine interaction method and apparatus, electronic device, product, medium, and vehicle
By displaying vehicle icons on the intelligent driving perception screen of autonomous vehicles and detecting user touch operations to generate control commands, the problem of users being unable to flexibly control vehicle driving is solved, achieving a flexible control method and an improved user experience.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- ZHEJIANG GEELY HLDG GRP CO LTD
- Filing Date
- 2026-01-22
- Publication Date
- 2026-07-30
AI Technical Summary
In autonomous vehicles, users cannot flexibly control the vehicle to drive according to their own wishes, resulting in inflexible manual driving and autonomous driving control methods and a poor user experience.
By generating and displaying vehicle identifiers in the surrounding environment on the vehicle's intelligent driving perception screen, the system can detect user touch operations in real time, generate corresponding control commands, and control the vehicle to drive in the manner specified by the user.
It achieves flexibility in both manual and autonomous driving control methods, enhances the personalization of intelligent driving systems, and improves the user experience of autonomous driving.
Smart Images

Figure CN2026074235_30072026_PF_FP_ABST
Abstract
Description
Human-computer interaction methods, devices, electronic equipment, products, media, and vehicles Cross-references to related applications
[0001] This application claims priority to Chinese patent application No. 202510106358.0, filed on January 22, 2025, the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to, but is not limited to, the field of intelligent driving technology, and particularly to a human-machine interaction method, device, electronic device, program product, storage medium, and vehicle for vehicle control. Background Technology
[0003] In recent years, with the development of intelligent driving technology, more and more vehicles on the market have acquired autonomous driving capabilities. The realization of autonomous driving relies on the vehicle's Advanced Driver Assistance System (ADAS). After the vehicle engages autonomous driving, the ADAS acquires real-time data about the vehicle's environment and can make judgments based on preset intelligent driving strategies, controlling the vehicle to safely travel to its destination along a planned route while adhering to traffic rules. Summary of the Invention
[0004] The following is an overview of the subject matter described in detail herein. This overview is not intended to limit the scope of the claims.
[0005] This application provides a human-computer interaction method, device, electronic device, program product, storage medium, and vehicle for vehicle control.
[0006] In a first aspect, embodiments of this application provide a human-machine interaction method for vehicle control, comprising: acquiring real-time perception data of the vehicle's surrounding environment; generating and displaying vehicle identifiers corresponding to vehicles in the surrounding environment on a smart driving perception screen of the vehicle based on the real-time perception data; wherein the vehicle identifiers are configured to indicate real-time vehicle information in the surrounding environment; in response to determining that the vehicle can be controlled based on the real-time vehicle information, generating a vehicle control touch identifier based on the vehicle identifiers; detecting touch operations received by the vehicle control touch identifiers in real time, generating a control command corresponding to the vehicle control touch identifiers that received the touch operations; and controlling the vehicle to drive relative to other vehicles in the surrounding environment according to the control command.
[0007] In some embodiments of this application, the vehicle identifier includes a vehicle identifier corresponding to the vehicle itself and a vehicle identifier corresponding to another vehicle; generating a vehicle control touch identifier based on the vehicle identifier includes: setting the vehicle identifier as the vehicle control touch identifier; real-time detection of touch operations received by the vehicle control touch identifier and generating a control command corresponding to the vehicle control touch identifier that received the touch operation includes: in response to detecting that the touch operation received by the vehicle identifier as the vehicle control touch identifier is a movement operation, obtaining the relative positional relationship between the vehicle identifier and the other vehicle identifier when the movement operation ends; generating a corresponding control command based on the relative positional relationship.
[0008] In some embodiments of this application, generating corresponding control instructions based on the relative positional relationship includes: determining whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; in response to determining that the vehicle identifier and the other vehicle identifier overlap when the movement operation ends, identifying the other vehicle corresponding to the other vehicle identifier that overlaps with the vehicle identifier when the movement operation ends as the target vehicle; and generating control instructions to control the vehicle to follow the target vehicle.
[0009] In some embodiments of this application, generating corresponding control commands based on the relative positional relationship includes: determining whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; in response to determining that the vehicle identifier and the other vehicle identifier do not overlap when the movement operation ends, and that the other vehicle identifier is included between the starting position and the ending position of the movement operation, identifying the other vehicle corresponding to the other vehicle identifier included between the starting position and the ending position as the target vehicle; and generating control commands to control the vehicle to overtake the target vehicle.
[0010] In some embodiments of this application, the vehicle identifier includes the identifier of another vehicle corresponding to the other vehicle; generating a vehicle control touch identifier based on the vehicle identifier includes: setting the other vehicle identifier as a vehicle control touch identifier; real-time detection of touch operations received by the vehicle control touch identifier and generating a control command corresponding to the vehicle control touch identifier that received the touch operation includes: in response to detecting that the touch operation received by the other vehicle identifier, which is the vehicle control touch identifier, is a preset vehicle control touch operation, determining the other vehicle corresponding to the other vehicle identifier that received the touch operation as the target vehicle, and generating a control command to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation.
[0011] In some embodiments of this application, the vehicle control touch operation includes a following touch operation; the step of responding to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is a preset vehicle control touch operation, determining the other vehicle corresponding to the other vehicle identifier that received the touch operation as the target vehicle, and generating a control command to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation, includes: responding to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is the following touch operation, determining the other vehicle corresponding to the other vehicle identifier that received the touch operation as the target vehicle; and generating a control command to control the vehicle to follow the target vehicle.
[0012] In some embodiments of this application, the vehicle control touch operation includes an overtaking touch operation; the step of responding to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is a preset vehicle control touch operation, determining the other vehicle corresponding to the other vehicle identifier that received the touch operation as the target vehicle, and generating a control command to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation, includes: responding to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is the overtaking touch operation, determining the other vehicle corresponding to the other vehicle identifier that received the touch operation as the target vehicle; and generating a control command to control the vehicle to overtake the target vehicle.
[0013] In some embodiments of this application, the touch operation received by the vehicle control touch icon includes a following touch operation or an overtaking touch operation; the real-time detection of the touch operation received by the vehicle control touch icon includes: real-time detection of a first touch operation received by the vehicle control touch icon; in response to not receiving a second touch operation of the same type as the first touch operation within a preset interval after detecting the first touch operation, determining the first touch operation as the touch operation received by the vehicle control touch icon; in response to receiving a second touch operation of the same type as the first touch operation within a preset interval after detecting the first touch operation, determining the touch operation superimposed by the first touch operation and the second touch operation as the touch operation received by the vehicle control touch icon; wherein, one of the following touch operation and the overtaking touch operation is the first touch operation, and the other of the following touch operation and the overtaking touch operation is the touch operation superimposed by the first touch operation and the second touch operation.
[0014] In some embodiments of this application, the first touch operation and the second touch operation are click operations, and the following touch operation and the overtaking touch operation are click operations with different numbers of consecutive touches.
[0015] In some embodiments of this application, one of the following touch operation and the overtaking touch operation is a two-click operation, and the other of the following touch operation and the overtaking touch operation is a more than two-click operation.
[0016] In some embodiments of this application, the vehicle identifier includes the identifier of the other vehicle corresponding to the other vehicle; generating a vehicle control touch identifier based on the vehicle identifier includes: generating a vehicle control identifier independent of the other vehicle identifier around the other vehicle identifier; wherein, the vehicle control identifier includes a following touch identifier and / or an overtaking touch identifier; real-time detection of touch operations received by the vehicle control touch identifier and generating a control command corresponding to the vehicle control touch identifier that received the touch operation includes: real-time detection of touch operations received by either the following touch identifier or the overtaking touch identifier, identifying the other vehicle corresponding to the following touch identifier or the overtaking touch identifier that received the touch operation as the target vehicle, and generating a control command to control the vehicle to follow the target vehicle or a control command to control the vehicle to overtake the target vehicle.
[0017] In some embodiments of this application, the vehicle identifier includes a touch identifier corresponding to the other vehicle; generating a vehicle control touch identifier based on the vehicle identifier includes: real-time detection of touch operations received by the other vehicle touch identifier, and in response to the touch operation received by the other vehicle touch identifier being a touch operation to select a vehicle control mode, displaying vehicle control identifiers including a following touch identifier and / or an overtaking touch identifier; wherein, the vehicle control identifier is configured to indicate the real-time vehicle control mode of the vehicle relative to the other vehicle; real-time detection of touch operations received by the vehicle control touch identifier and generating a control command corresponding to the vehicle control touch identifier that received the touch operation includes: real-time detection of touch operations received by either the following touch identifier or the overtaking touch identifier, determining the other vehicle corresponding to the following touch identifier or the overtaking touch identifier that received the touch operation as the target vehicle, and generating a control command to control the vehicle to follow the target vehicle or a control command to control the vehicle to overtake the target vehicle.
[0018] Secondly, embodiments of this application provide a human-machine interface device for vehicle control, comprising: a display module configured to acquire real-time perception data of the vehicle's surrounding environment, and generate and display vehicle identifiers corresponding to vehicles in the surrounding environment on the vehicle's intelligent driving perception screen based on the real-time perception data; wherein the vehicle identifiers are configured to indicate real-time vehicle information in the surrounding environment; a generation module configured to generate a vehicle control touch identifier based on the vehicle identifier in response to determining, based on the real-time vehicle information, that the vehicle can be controlled; a touch module configured to detect touch operations received by the vehicle control touch identifier in real time, and generate control commands corresponding to the vehicle control touch identifier that received the touch operations; and a control module configured to control the vehicle to drive relative to other vehicles in the surrounding environment according to the control commands.
[0019] Thirdly, embodiments of this application provide an electronic device including one or more processors, the one or more processors being configured to implement a human-machine interaction method for vehicle control as described in any of the first aspects.
[0020] Fourthly, embodiments of this application provide a non-transitory computer-readable storage medium storing computer-executable instructions, which, when executed by at least one processor, implement the human-machine interaction method for vehicle control as described in any one of the first aspects.
[0021] Fifthly, embodiments of this application provide a computer program product, including a computer program stored on a computer-readable storage medium, wherein when the computer program is executed by at least one processor, it implements the human-machine interaction method for vehicle control as described in any one of the first aspects.
[0022] In a sixth aspect, embodiments of this application provide a vehicle, comprising: a human-machine interface device for vehicle control as described in any of the second aspects; or an electronic device as described in any of the third aspects; or a non-transitory computer-readable storage medium as described in any of the fourth aspects; or a computer program product as described in any of the fifth aspects; or at least one processor configured to implement the human-machine interface method for vehicle control as described in any of the first aspects.
[0023] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this specification. Other aspects will become clear after reading and understanding the accompanying drawings and detailed description. Attached Figure Description
[0024] The accompanying drawings are included to provide a further understanding of the technical solutions of this application, are incorporated in and constitute a part of this specification, illustrate embodiments consistent with this application, and are used together with the specification to explain the principles of this application, but do not constitute a limitation on the technical solutions of this application.
[0025] Figure 1 shows a schematic diagram of the applicable scenarios for the human-computer interaction method for vehicle control according to an embodiment of this application.
[0026] Figure 2 is a flowchart illustrating the human-computer interaction method for vehicle control according to an embodiment of this application.
[0027] Figure 3 is a schematic diagram of an electronic image according to an embodiment of this application.
[0028] Figure 4 shows a structural block diagram of a human-machine interaction device for vehicle control according to an embodiment of this application.
[0029] Figure 5 shows a structural block diagram of an electronic device according to an embodiment of this application. Detailed Implementation
[0030] The technical solutions in the embodiments of this application will be clearly and completely described herein with reference to the accompanying drawings. In the following description, when referring to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements.
[0031] The embodiments described below are not representative of all embodiments consistent with one or more embodiments of this specification. Rather, they are merely examples of apparatuses and methods consistent with some aspects of one or more embodiments of this specification as detailed in the appended claims. It should be noted that the steps of the corresponding methods in other embodiments are not necessarily performed in the order shown and described in this specification. In some other embodiments, the methods may include more or fewer steps than described in this specification. Furthermore, a single step described in this specification may be broken down into multiple steps in other embodiments; and multiple steps described in this specification may be combined into a single step in other embodiments.
[0032] In an alternative embodiment, in a vehicle with autonomous driving capabilities, the advanced driver assistance system typically controls the vehicle to drive according to a preset driving mode, making it impossible for the user to control the vehicle to drive as they wish.
[0033] To address the technical problem of users being unable to control their vehicles to drive according to their own wishes during autonomous driving, this application provides a human-machine interaction method for vehicle control. This method generates and displays vehicle identifiers corresponding to other vehicles in the surrounding environment on the vehicle's intelligent driving perception screen. Based on these vehicle identifiers, a vehicle control touch identifier is generated. The user's touch operations are detected in real time, and control commands corresponding to the touched vehicle control touch identifier are generated. The user then controls the vehicle to drive relative to other vehicles in the surrounding environment according to the control commands. This provides a touch-based interaction method between the user and the intelligent driving system, allowing the user to request the intelligent driving system to control the vehicle to drive in a manner they specify through touch interaction.
[0034] Furthermore, if the driving modes preset by the advanced driver assistance system (ADAS) do not match the user's driving habits, and the user wants to drive the vehicle according to their own preferences, the user needs to take over control of the vehicle from the ADAS, allowing the user to drive as the driver. In other words, while the vehicle is in motion, it must either be entirely controlled by the ADAS or entirely by the user. This results in inflexible control methods for both manual and autonomous driving, and a poor user experience for autonomous driving. For example, when the ADAS is controlling the vehicle, the user may want to follow or overtake a vehicle, but the ADAS cannot determine whether the user intends to follow or overtake, or which vehicle is being followed or overtaken.
[0035] To address the technical problem of inflexible control methods in both manual and autonomous driving, this application provides a human-machine interaction method for vehicle control. Before generating a vehicle control touch icon based on the vehicle identifier, the method determines whether the vehicle can be controlled based on real-time vehicle information indicated by the vehicle identifier. Through user-executed touch operations and real-time detection of these operations by the intelligent driving system, the user and the intelligent driving system cooperate, making the control methods for both manual and autonomous driving more flexible. Furthermore, this method enhances the personalization of the intelligent driving system while ensuring driving safety, thereby improving the user experience of autonomous driving.
[0036] Please refer to Figure 1, which is a schematic diagram of the applicable scenario for the human-machine interaction method for vehicle control according to an embodiment of this application. The human-machine interaction method for vehicle control provided in this embodiment can be applied to a vehicle 10 with an intelligent driving system. The vehicle 10 may include a touch screen 11 and an electronic device connected to the touch screen 11. The electronic device may be, but is not limited to, a controller or a processor. The controller may include, but is not limited to, a body controller, a domain controller, etc., which will not be listed here. It should be noted that the vehicle 10 may also include other components not shown in Figure 1. The description of these other components can be found in relevant descriptions in the automotive field, and will not be repeated here.
[0037] Please refer to Figure 2, which is a flowchart illustrating the human-machine interaction method for vehicle control according to an embodiment of this application. The human-machine interaction method for vehicle control provided in this embodiment includes, but is not limited to, the following steps S101 to S104.
[0038] In step S101, real-time perception data of the vehicle's surrounding environment is acquired, and based on the real-time perception data, vehicle identifiers corresponding to the vehicles in the surrounding environment are generated and displayed on the vehicle's intelligent driving perception screen; wherein, the vehicle identifiers are used to indicate real-time vehicle information in the surrounding environment.
[0039] Intelligent driving systems can use various sensors installed on the vehicle (such as millimeter-wave radar, lidar, mono / dual-lens cameras, and satellite navigation) to perceive the vehicle's surroundings in real time while the vehicle is in motion. They acquire real-time perception data of this environment and use this data to identify, detect, and track static and dynamic objects. To display the vehicle's surroundings to the user and facilitate real-time awareness of this information, the intelligent driving system can generate and display electronic images of the vehicle's surroundings on the Advanced Driver Assistance System View (ADV).
[0040] The electronic image may include vehicle identifiers and lane identifiers. In this embodiment, the vehicle identifier is the identifier corresponding to a vehicle in the vehicle's surrounding environment, and may include the vehicle identifier corresponding to the vehicle itself and the identifiers corresponding to other vehicles, used to indicate real-time vehicle information in the surrounding environment; the lane identifier is the identifier corresponding to a lane in the vehicle's surrounding environment, and may include the identifier corresponding to the lane the vehicle is in and the identifier corresponding to a lane the vehicle is not in, used to indicate real-time lane information in the surrounding environment. In some embodiments, the electronic image may also include only the vehicle identifier and the identifiers of other vehicles without including lane identifiers. This embodiment does not limit the specific types of sensed objects in the vehicle's surrounding environment included in the electronic image.
[0041] Please refer to Figure 3, which is a schematic diagram of an electronic image according to an embodiment of this application. The electronic image includes a vehicle identifier, other vehicle identifiers, and lane identifiers. The other vehicle identifier may include a graphic of the other vehicle and / or its number, and the lane identifier may include a graphic of the lane and / or its number. The electronic image shown in Figure 3 will be described in detail below.
[0042] Lane markings include lane graphics and lane numbers ①, ②, ③, and ④. A solid line and a dashed line form the lane graphic for the rightmost lane (lane ①) traveling in the same direction as the vehicle. Two dashed lines form the lane graphic for the middle lane (lane ②) traveling in the same direction as the vehicle. A dashed line and a solid line form the lane graphic for the leftmost lane (lane ③) traveling in the same direction as the vehicle. A dashed line and a solid line form the lane graphic for the leftmost lane (lane ④) traveling in the opposite direction to the vehicle.
[0043] The other vehicle identification includes a graphic of the other vehicle and its number, A, B, C, or D. Vehicles A, B, and C are traveling in the same direction as your vehicle, respectively, in lanes ①, ②, and ③. Vehicle D is traveling in the opposite direction to your vehicle, in lane ④.
[0044] Setting a vehicle identifier as a touchable identifier creates a vehicle touchable identifier. A vehicle touchable identifier can include its own vehicle touchable identifier and / or other vehicles' touchable identifiers. Compared to a standard vehicle identifier, a vehicle touchable identifier can not only indicate real-time vehicle information in the vehicle's surroundings but also receive touch input from the user. The user can specify a vehicle by touching the vehicle touchable identifier in the electronic image.
[0045] It should be noted that in the electronic image shown in Figure 3, the vehicle's graphic is black, the graphics of other vehicles (B and C) are white, the graphics of other vehicles (A and D) are gray, the lane graphics of lanes ①, ②, and ③ are white, and the lane graphic of lane ④ is gray (represented by a diagonally filled line in Figure 3). A white other vehicle graphic indicates that the current vehicle can perform at least one vehicle control mode (such as overtaking or following) relative to the other vehicle represented by that graphic, while a gray other vehicle graphic indicates that the current vehicle cannot perform any vehicle control mode relative to the other vehicle represented by that graphic. Similarly, a white lane graphic indicates that the current vehicle can perform at least one lane control mode (such as changing lanes) relative to the lane represented by that lane graphic, while a gray lane graphic indicates that the current vehicle cannot perform any lane control mode relative to the lane represented by that lane graphic. In specific scenarios, the colors of the other vehicle graphics corresponding to different other vehicles and the lane graphics corresponding to different lanes can be specifically set, and the colors of the other vehicle numbers corresponding to different other vehicles and the lane numbers corresponding to different lanes can also be different accordingly. For example, the vehicle identification mark can be set to the vehicle's actual color, the other vehicle identification mark (which can be controlled by at least one vehicle control method) can be set to green, and the other vehicle identification mark (which cannot be controlled by any vehicle control method) can be set to red. This application embodiment does not limit the specific colors of different lane markings, different other vehicle identification marks, and the vehicle identification mark.
[0046] In step S102, when it is determined that the vehicle can be controlled based on the real-time vehicle information, a vehicle control touch icon is generated based on the vehicle icon.
[0047] The intelligent driving system determines the vehicle control methods that the vehicle can perform relative to other vehicles in its surrounding environment based on real-time vehicle information and preset intelligent driving strategies. When the intelligent driving system determines that it can control the vehicle based on real-time vehicle information and preset intelligent driving strategies, it generates a vehicle control touch icon based on the vehicle identifier. The vehicle control touch icon is used to receive touch operations, so that when the intelligent driving system detects that the vehicle control touch icon has been touched, it generates corresponding control commands.
[0048] In some embodiments, the vehicle identifier is a touchable vehicle identifier. When the intelligent driving system generates a vehicle control touch identifier based on the vehicle identifier, it directly sets the touchable vehicle identifier as the vehicle control touch identifier, thereby assigning the function of the vehicle control touch identifier to the vehicle identifier. This allows the vehicle identifier to have both indication and touch functions, enabling it to indicate real-time vehicle information in the vehicle's surrounding environment and to receive touch operations so that the intelligent driving system can generate corresponding control commands.
[0049] In some embodiments, the vehicle identifier is a non-touchable vehicle identifier. When the intelligent driving system generates a vehicle control touch identifier based on the vehicle identifier, it needs to generate an additional vehicle control touch identifier.
[0050] In step S103, the touch operation received by the vehicle control touch icon is detected in real time, and a control command corresponding to the touched vehicle control touch icon is generated.
[0051] When a user performs a touch operation on the vehicle control touch icon, the vehicle control touch icon receives the touch operation. After detecting that the vehicle control touch icon has been touched, the intelligent driving system generates a control command corresponding to the touched vehicle control touch icon to respond to the user's touch operation, facilitating subsequent control of the vehicle to drive according to the control command. In the embodiments of this application, the control command typically includes the target vehicle and the vehicle control method of the self-vehicle relative to the target vehicle.
[0052] In step S104, the vehicle is controlled to drive relative to other vehicles in the surrounding environment according to the control command.
[0053] After generating a control command corresponding to the touched vehicle control touch icon, the intelligent driving system controls the vehicle to drive relative to other vehicles in its surrounding environment according to the control command. Because the generated control command usually includes the target vehicle and the vehicle control method of the vehicle relative to the target vehicle, the intelligent driving system can control the vehicle to drive in the manner specified by the user by controlling the vehicle to drive relative to the target vehicle in the control command according to the vehicle control method in the control command.
[0054] In some embodiments, the vehicle identifiers mentioned above include a vehicle identifier corresponding to the vehicle itself and a vehicle identifier corresponding to another vehicle. When generating a vehicle control touch identifier based on the vehicle identifier in step S102, the process specifically includes the following steps: setting the vehicle identifier as the vehicle control touch identifier. When detecting touch operations received by the vehicle control touch identifier in real time and generating a control command corresponding to the touched vehicle control touch identifier in step S103, the process specifically includes the following steps: in response to detecting that the touch operation received by the vehicle identifier (which serves as the vehicle control touch identifier) is a movement operation, obtaining the relative positional relationship between the vehicle identifier and the other vehicle identifier when the movement operation ends; and generating a corresponding control command based on the relative positional relationship.
[0055] If the vehicle identification sign is touch-sensitive, it is directly set as a vehicle control touch sign, thus assigning the vehicle control touch sign its functionality. This allows users to request the intelligent driving system to control the vehicle by touching the vehicle identification sign. This setup enables the vehicle identification sign to both indicate the vehicle and receive touch operations, achieving functional reuse and saving the vehicle's network and power resources.
[0056] Because users can perform various touch operations on the vehicle icon, a specific touch operation needs to be defined for each operation to distinguish it from other touch operations that perform different functions. For example, the touch operation on the vehicle icon can be defined as a movement operation to confirm that it is a touch operation performed on the vehicle icon, which serves as the vehicle control touch icon. In this embodiment, the movement operation can be dragging or swiping. It should be noted that the touch operation performed on the vehicle icon is not limited to movement operations; other touch operations are also possible. This embodiment does not limit the specific touch operation performed on the vehicle icon, which serves as the vehicle control touch icon.
[0057] In some embodiments, when generating the corresponding control command based on the relative position relationship in the above steps, the following steps are specifically included: determining whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; in response to determining that the vehicle identifier and the other vehicle identifier overlap when the movement operation ends, determining the other vehicle corresponding to the other vehicle identifier that overlaps with the vehicle identifier when the movement operation ends as the target vehicle; and generating a control command to follow the target vehicle.
[0058] The position of the vehicle icon at the end of the movement operation is the position where the user releases the vehicle icon after touching it. If the user moves the vehicle icon to another vehicle icon to end the touch operation, the vehicle icon and the other vehicle icon will overlap at the end of the movement operation. The intelligent driving system determines that the user wants to control the vehicle to follow the other vehicle corresponding to the overlapping other vehicle icon. Therefore, the other vehicle corresponding to the overlapping other vehicle icon at the end of the movement operation is identified as the target vehicle, and a control command to follow the target vehicle is generated.
[0059] In some embodiments, when generating the corresponding control command based on the relative positional relationship in the above steps, the steps specifically include the following: determining whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; in response to determining that the vehicle identifier and the other vehicle identifier do not overlap when the movement operation ends, and that the other vehicle identifier is included between the starting position and the ending position of the movement operation, the other vehicle corresponding to the other vehicle identifier included between the starting position and the ending position is identified as the target vehicle; and generating a control command to drive past the target vehicle.
[0060] The position of the vehicle icon at the end of the movement operation is the position where the user releases the vehicle icon after touching it. If the user moves the vehicle icon in front of another vehicle icon to end the touch operation, then at the end of the movement operation, the vehicle icon and the other vehicle icon do not overlap, and the other vehicle icon is included between the start and end positions of the movement operation. The intelligent driving system determines that the user wants to control the vehicle to pass the other vehicle corresponding to the other vehicle icon located between the start and end positions of the movement operation. Therefore, the other vehicle corresponding to the other vehicle icon located between the start and end positions of the movement operation is identified as the target vehicle at the end of the movement operation, and a control command to pass the target vehicle is generated.
[0061] In some embodiments, the vehicle identifier mentioned above includes the identifier of another vehicle corresponding to another vehicle; when generating a vehicle control touch identifier based on the vehicle identifier in step S102, the specific steps include: setting the other vehicle identifier as a vehicle control touch identifier; when detecting the touch operation received by the vehicle control touch identifier in real time in step S103 and generating a control command corresponding to the touched vehicle control touch identifier, the specific steps include: if the touch operation received by the other vehicle identifier, which is the vehicle control touch identifier, is detected to be a preset vehicle control touch operation, then the other vehicle corresponding to the touched other vehicle identifier is determined as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation.
[0062] If the other vehicle identifier is a touch-sensitive identifier, it is directly set as the vehicle control touch identifier, thus assigning the vehicle control touch identifier's functions to the other vehicle identifier. This allows the user to request the intelligent driving system to control the vehicle's movement by touching the other vehicle identifier. This setup enables the other vehicle identifier to both indicate other vehicles in the surrounding environment and receive touch operations, achieving functional reuse and saving vehicle network and power resources.
[0063] Because users can perform various touch operations on other vehicle icons, it is necessary to define a specific touch operation for each icon to distinguish between touch operations that perform different functions, in order to confirm that the touch operation is performed by the user on the vehicle control touch icon. For example, the touch operation for the other vehicle icon can be defined as a click operation to confirm that the touch operation is performed on the other vehicle icon that serves as the vehicle control touch icon. In this embodiment, the click operation can be a single click or multiple clicks. It should be noted that the touch operation performed on the other vehicle icon is not limited to a click operation and can also be other touch operations. This embodiment does not limit the specific touch operation performed on the other vehicle icon that serves as the vehicle control touch icon.
[0064] In some embodiments, the above-mentioned vehicle control touch operation includes a following touch operation; if the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is detected as a preset vehicle control touch operation, then the other vehicle corresponding to the touched other vehicle identifier is identified as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle according to the vehicle control method corresponding to the vehicle control touch operation. Specifically, this includes the following steps: if the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is detected as a following touch operation, then the other vehicle corresponding to the touched other vehicle identifier is identified as the target vehicle; and a control command is generated to follow the target vehicle.
[0065] If the touch operation received by the other vehicle identifier, which is used as the vehicle control touch identifier, is a preset follow touch operation, the intelligent driving system determines that the user wants to control the vehicle to follow the other vehicle corresponding to the touched other vehicle identifier. Then, the other vehicle corresponding to the touched other vehicle identifier is identified as the target vehicle, and a control command to follow the target vehicle is generated.
[0066] In some embodiments, the above-mentioned vehicle control touch operation includes an overtaking touch operation; if the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is detected as a preset vehicle control touch operation, then the other vehicle corresponding to the touched other vehicle identifier is identified as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle according to the vehicle control method corresponding to the vehicle control touch operation. Specifically, this includes the following steps: if the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is detected as an overtaking touch operation, then the other vehicle corresponding to the touched other vehicle identifier is identified as the target vehicle; and a control command is generated to overtake the target vehicle.
[0067] If the touch operation received by the other vehicle identifier, which is used as the vehicle control touch identifier, is a preset overtaking touch operation, the intelligent driving system determines that the user wants to control the vehicle to overtake the other vehicle corresponding to the touched other vehicle identifier. Then, the other vehicle corresponding to the touched other vehicle identifier is identified as the target vehicle, and a control command to overtake the target vehicle is generated.
[0068] In some embodiments, the touch operation received by the vehicle control touch icon includes a following touch operation or an overtaking touch operation; when detecting the touch operation received by the vehicle control touch icon in real time in step S103, the specific steps include: detecting the first touch operation received by the vehicle control touch icon in real time; if no second touch operation of the same type as the first touch operation is received within a preset interval after the first touch operation is detected, then the first touch operation is determined to be the touch operation received by the vehicle control touch icon; if a second touch operation of the same type as the first touch operation is received within a preset interval after the first touch operation is detected, then the touch operation superimposed by the first touch operation and the second touch operation is determined to be the touch operation received by the vehicle control touch icon; wherein, one of the following touch operation and the overtaking touch operation is the first touch operation, and the other of the following touch operation and the overtaking touch operation is the touch operation superimposed by the first touch operation and the second touch operation.
[0069] In some embodiments, the first touch operation is a click operation, and the following touch operation and the overtaking touch operation are click operations with different numbers of consecutive touches.
[0070] In some embodiments, the following touch operation and the overtaking touch operation are touch operations of the same type but different attributes; wherein, one of the following touch operation and the overtaking touch operation is a two-click operation, and the other of the following touch operation and the overtaking touch operation is a more than two-click operation.
[0071] To differentiate the touch operations for following and overtaking functions, the intelligent driving system sets the following and overtaking touch operations as the same type but different attributes, such as click operations with different numbers of consecutive touches. In some embodiments of this application, one of the following and overtaking touch operations is a double-click operation, and the other is a triple-click operation. It should be noted that the number of consecutive touches for the following and overtaking touch operations is not limited to two or three times; it can also be other numbers. This application does not impose such limitations.
[0072] In some embodiments, the vehicle identifier mentioned above includes the identifier of another vehicle corresponding to another vehicle; when generating a vehicle control touch identifier based on the vehicle identifier in step S102, the specific steps include: generating a vehicle control identifier independent of the other vehicle identifier around the other vehicle identifier; wherein, the vehicle control identifier includes a following touch identifier and / or an overtaking touch identifier; when detecting the touch operation received by the vehicle control touch identifier in real time in step S103 and generating a control command corresponding to the touched vehicle control touch identifier, the specific steps include: detecting the touch operation received by either the following touch identifier or the overtaking touch identifier in real time, identifying the other vehicle corresponding to the touched following touch identifier or overtaking touch identifier as the target vehicle, and generating a control command to follow the target vehicle or to overtake the target vehicle.
[0073] Based on real-time vehicle information and preset intelligent driving strategies, the intelligent driving system determines the vehicle control methods that the current vehicle can perform relative to other vehicles in its surrounding environment. It then generates a vehicle control identifier corresponding to the vehicle control method that the current vehicle can perform relative to a particular other vehicle and displays it around that identifier. For example, in the electronic image shown in Figure 3: if the current vehicle can follow vehicle B, then a following touch control identifier is generated and displayed around vehicle B's other vehicle identifier; if the current vehicle can follow or overtake vehicle C, then a following touch control identifier and an overtaking touch control identifier are generated and displayed around vehicle C's other vehicle identifier.
[0074] When a user touches either the following touch icon or the overtaking touch icon, the following or overtaking touch icon will receive the touch operation. Upon detecting that a following or overtaking touch icon has been touched, the intelligent driving system identifies the other vehicle corresponding to the touched following or overtaking touch icon as the target vehicle and generates control commands to follow or overtake the target vehicle. For example, in the electronic image shown in Figure 3: if the following touch icons around the other vehicle icon of vehicle B are touched, vehicle B is identified as the target vehicle, and control commands to follow vehicle B are generated; if the following or overtaking touch icons around the other vehicle icon of vehicle C are touched, vehicle C is identified as the target vehicle, and control commands to follow or overtake vehicle C are generated.
[0075] In some embodiments, the vehicle identifier mentioned above includes a touch-sensitive identifier for another vehicle; wherein, the touch-sensitive identifier for another vehicle is used to indicate other vehicles in the surrounding environment of the vehicle and to receive touch operations; when generating a vehicle control touch-sensitive identifier based on the vehicle identifier in step S102, the following steps are specifically included: real-time detection of touch operations received by the touch-sensitive identifier for another vehicle; if the touch operation received by the touch-sensitive identifier for another vehicle is a touch operation to select a vehicle control mode, then displaying vehicle control identifiers including a following touch-sensitive identifier and / or an overtaking touch-sensitive identifier; wherein, the vehicle The control identifier is used to indicate the real-time vehicle control mode of the vehicle relative to other vehicles. In step S103 above, when the touch operation received by the vehicle control touch identifier is detected in real time and the control command corresponding to the touched vehicle control touch identifier is generated, the following steps are specifically included: real-time detection of the touch operation received by either the following touch identifier or the overtaking touch identifier, determining the other vehicle corresponding to the touched following touch identifier or overtaking touch identifier as the target vehicle, and generating a control command to follow the target vehicle or to overtake the target vehicle.
[0076] If the other vehicle's identifier is a touchable identifier, then the other vehicle's identifier becomes a touchable identifier, and the touch operation received by the other vehicle's touchable identifier is detected in real time. When the user performs a touch operation on the other vehicle's touchable identifier, the other vehicle's touchable identifier will receive the touch operation. If the touch operation received by the other vehicle's touchable identifier is a touch operation to select a vehicle control mode, then vehicle control identifiers including the follow touch indicator and / or the overtaking touch indicator are displayed. In the embodiments of this application, the touch operation to select a vehicle control mode can be a long press operation or a click operation. For example, in the electronic image shown in Figure 3: the current vehicle can follow vehicle B, and after the user long presses the other vehicle's touch indicator of vehicle B, the intelligent driving system displays vehicle control identifiers that only include the follow touch indicator; the current vehicle can follow or overtake vehicle C, and after the user long presses the other vehicle's touch indicator of vehicle C, the intelligent driving system displays vehicle control identifiers that include both the follow touch indicator and the overtaking touch indicator.
[0077] When a user touches either the following touch icon or the overtaking touch icon, the following or overtaking touch icon will receive the touch operation. Upon detecting that the following or overtaking touch icon has been touched, the intelligent driving system identifies the other vehicle corresponding to the touched following or overtaking touch icon as the target vehicle and generates a control command to follow or overtake the target vehicle. For example, in the electronic image shown in Figure 3: if the other vehicle touch icon of vehicle B is touched, and the pop-up following touch icon is also touched, then vehicle B is identified as the target vehicle, and a control command to follow vehicle B is generated; if the other vehicle touch icon of vehicle C is touched, and the pop-up following or overtaking touch icon is also touched, then vehicle C is identified as the target vehicle, and a control command to follow or overtake vehicle C is generated.
[0078] This application also provides a human-machine interface device for vehicle control. Please refer to FIG4, which is a structural block diagram of the human-machine interface device for vehicle control according to an embodiment of this application. The human-machine interface device 21 for vehicle control provided in this application embodiment may include a display module 211, a generation module 212, a touch module 213, and a control module 214.
[0079] The display module 211 is configured to acquire real-time perception data of the vehicle's surrounding environment, and generate and display vehicle identifiers corresponding to vehicles in the surrounding environment on the vehicle's intelligent driving perception screen based on the real-time perception data; wherein, the vehicle identifier is used to indicate real-time vehicle information in the surrounding environment.
[0080] The generation module 212 is configured to generate a vehicle control touch icon based on the vehicle icon when it is determined that the vehicle can be controlled based on the real-time vehicle information.
[0081] The touch module 213 is configured to detect the touch operation received by the vehicle control touch icon in real time and generate a control command corresponding to the touched vehicle control touch icon.
[0082] The control module 214 is configured to control the vehicle to drive relative to other vehicles in the surrounding environment according to the control command.
[0083] The specific implementation process of the functions and roles of each module in the above device can be found in the implementation process of the corresponding steps in the above method, which can achieve the same technical effect, and will not be repeated here.
[0084] In some embodiments, the vehicle identifier includes a self-vehicle identifier corresponding to the self-vehicle and a other-vehicle identifier corresponding to another vehicle; when the generation module 212 generates a vehicle control touch identifier based on the vehicle identifier, it is specifically configured to set the self-vehicle identifier as the vehicle control touch identifier; when the touch module 213 detects the touch operation received by the vehicle control touch identifier in real time and generates a control command corresponding to the touched vehicle control touch identifier, it is specifically configured to: if the touch operation received by the self-vehicle identifier as the vehicle control touch identifier is detected to be a movement operation, then obtain the relative positional relationship between the self-vehicle identifier and the other-vehicle identifier when the movement operation ends; and generate a corresponding control command based on the relative positional relationship.
[0085] In some embodiments, when the touch module 213 generates a corresponding control command based on the relative position relationship, it is specifically configured to: determine whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; in response to determining that the vehicle identifier and the other vehicle identifier overlap when the movement operation ends, determine the other vehicle corresponding to the other vehicle identifier that overlaps with the vehicle identifier when the movement operation ends as the target vehicle; and generate a control command to follow the target vehicle.
[0086] In some embodiments, when the touch module 213 generates a corresponding control command based on the relative positional relationship, it is specifically configured to: determine whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; in response to determining that the vehicle identifier and the other vehicle identifier do not overlap when the movement operation ends, and that the other vehicle identifier is included between the starting position and the ending position of the movement operation, identify the other vehicle corresponding to the other vehicle identifier included between the starting position and the ending position as the target vehicle; and generate a control command to drive past the target vehicle.
[0087] In some embodiments, the aforementioned vehicle identifier includes the identifier of another vehicle corresponding to another vehicle; when the generation module 212 generates a vehicle control touch identifier based on the vehicle identifier, it is specifically configured to set the other vehicle identifier as a vehicle control touch identifier; when the touch module 213 detects the touch operation received by the vehicle control touch identifier in real time and generates a control command corresponding to the touched vehicle control touch identifier, it is specifically configured to: if the touch operation received by the other vehicle identifier, which is the vehicle control touch identifier, is detected to be a preset vehicle control touch operation, then the other vehicle corresponding to the touched other vehicle identifier is determined as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation.
[0088] In some embodiments, the above-described vehicle control touch operation includes a following vehicle touch operation.
[0089] If the touch module 213 detects that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is a preset vehicle control touch operation, then the other vehicle corresponding to the touched other vehicle identifier is identified as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation. Specifically, if the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is detected as a follow touch operation, then the other vehicle corresponding to the touched other vehicle touch identifier is identified as the target vehicle; and a control command is generated to follow the target vehicle.
[0090] In some embodiments, the above-mentioned vehicle control touch operation includes an overtaking touch operation; when the touch module 213 detects that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is a preset vehicle control touch operation, it determines the other vehicle corresponding to the touched other vehicle identifier as the target vehicle and generates a control command to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation. Specifically, if the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is detected as an overtaking touch operation, it determines the other vehicle corresponding to the touched other vehicle identifier as the target vehicle and generates a control command to overtake the target vehicle.
[0091] In some embodiments, the touch operation received by the vehicle control touch icon includes a following touch operation or an overtaking touch operation; when the touch module 213 detects the touch operation received by the vehicle control touch icon in real time, it is specifically configured to: detect the first touch operation received by the vehicle control touch icon in real time; if no second touch operation of the same type as the first touch operation is received within a preset interval after the first touch operation is detected, then the first touch operation is determined to be the touch operation received by the vehicle control touch icon; if a second touch operation of the same type as the first touch operation is received within a preset interval after the first touch operation is detected, then the touch operation superimposed by the first touch operation and the second touch operation is determined to be the touch operation received by the vehicle control touch icon; wherein, one of the following touch operation and the overtaking touch operation is the first touch operation, and the other of the following touch operation and the overtaking touch operation is the touch operation superimposed by the first touch operation and the second touch operation.
[0092] In some embodiments, the vehicle identifier mentioned above includes the identifier of another vehicle corresponding to another vehicle; when the generation module 212 generates a vehicle control touch identifier based on the vehicle identifier, it is specifically configured to generate a vehicle control identifier independent of the other vehicle identifier around the other vehicle identifier; wherein, the vehicle control identifier includes a following touch identifier and / or an overtaking touch identifier; when the touch module 213 detects the touch operation received by the vehicle control touch identifier in real time and generates a control command corresponding to the touched vehicle control touch identifier, it is specifically configured to: detect the touch operation received by either the following touch identifier or the overtaking touch identifier in real time, determine the other vehicle corresponding to the touched following touch identifier or overtaking touch identifier as the target vehicle, and generate a control command to follow the target vehicle or to overtake the target vehicle.
[0093] In some embodiments, the aforementioned vehicle identifier includes a touch-sensitive identifier for another vehicle; wherein, the touch-sensitive identifier for another vehicle is used to indicate other vehicles in the surrounding environment of the vehicle and to receive touch operations; when generating a vehicle control touch-sensitive identifier based on the vehicle identifier, the generation module 212 is specifically configured to: detect touch operations received by the touch-sensitive identifier for another vehicle in real time; if the touch operation received by the touch-sensitive identifier for another vehicle is a touch operation to select a vehicle control mode, then display vehicle control identifiers including a following touch-sensitive identifier and / or an overtaking touch-sensitive identifier; wherein, the vehicle control... The control sign is used to indicate the real-time vehicle control mode of the vehicle relative to other vehicles; when the touch module 213 detects the touch operation received by the vehicle control touch sign in real time and generates the control command corresponding to the touched vehicle control touch sign, the specific configuration is as follows: detect the touch operation received by either the following touch sign or the overtaking touch sign in real time, determine the other vehicle corresponding to the touched following touch sign or overtaking touch sign as the target vehicle, and generate a control command to follow the target vehicle or to overtake the target vehicle.
[0094] This application also provides an electronic device that may include the human-machine interface device 21 for vehicle control described above. Please refer to FIG5, which is a structural block diagram of the electronic device according to an embodiment of this application. The electronic device 20 may include one or more processors 22, which are configured to implement the human-machine interface method for vehicle control described above.
[0095] In some embodiments, the electronic device 20 may further include one or more computer-readable storage media 23, which may store a program that can be invoked by the processor 22, and may include non-volatile storage media. In other embodiments, the electronic device 20 may further include memory 24 and an interface 25. In still other embodiments, the electronic device 20 may also include other hardware depending on the specific application.
[0096] The computer-readable storage medium 23 provided in this application embodiment stores a program thereon, which, when executed by the processor 22, is used to implement the above-described human-machine interaction method for vehicle control.
[0097] This application may take the form of a computer program product implemented on one or more computer-readable storage media 23 (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code. The computer-readable storage media 23 includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented using any method or technology. This information may be computer-readable instructions, data structures, program modules, or other data. The computer-readable storage media 23 includes, but is not limited to: phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transfer medium, which can be used to store information accessible by a computing device.
[0098] This application also provides a computer program product, which includes a computer program that can be stored on a computer-readable storage medium. When the computer program is executed by at least one processor, it can perform the human-machine interaction method for vehicle control described in the above embodiments.
[0099] This application also provides a vehicle, including a human-machine interface device for vehicle control as described in the above embodiments, or an electronic device as described in the above embodiments, or a computer-readable storage medium as described in the above embodiments, or a computer program product as described in the above embodiments.
[0100] The human-machine interaction method, device, electronic device, program product, storage medium, and vehicle for vehicle control provided in this application embodiment generate and display vehicle identifiers corresponding to vehicles in the vehicle's surrounding environment on the vehicle's intelligent driving perception screen. Vehicle control touch identifiers are generated based on these vehicle identifiers, and user touch operations are detected in real time. Control commands corresponding to the touched vehicle control touch identifiers are generated, and the vehicle is controlled to drive relative to other vehicles in the surrounding environment according to the control commands. This provides a touch interaction method between the user and the intelligent driving system, allowing the user to request the intelligent driving system to control the vehicle to drive in a specified manner through touch interaction. Furthermore, before generating the vehicle control touch identifiers based on vehicle identifiers, real-time vehicle information is used to determine whether the vehicle can be controlled. This improves the personalization of the intelligent driving system while ensuring driving safety, thereby enhancing the user experience of autonomous driving.
[0101] Those skilled in the art will understand that all or part of the steps in the above methods can be implemented by a program instructing related hardware (e.g., a processor), and the program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk. Optionally, all or part of the steps in the above embodiments can also be implemented using one or more integrated circuits. Accordingly, each module / unit in the above embodiments can be implemented in hardware, such as by using an integrated circuit to implement its corresponding function, or it can be implemented in the form of a software functional module, such as by a processor executing a program / instruction stored in memory to implement its corresponding function. This application is not limited to any particular combination of hardware and software.
[0102] The above description is merely an exemplary embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this specification shall be included within the scope of protection of this specification.
[0103] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such process, method, article, or apparatus. Without further limitation, an element qualified by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.
Claims
1. A human-machine interaction method for vehicle control, comprising: The system acquires real-time perception data of the vehicle's surrounding environment, and generates and displays vehicle identifiers corresponding to vehicles in the surrounding environment on the vehicle's intelligent driving perception screen based on the real-time perception data; wherein the vehicle identifiers are configured to indicate real-time vehicle information in the surrounding environment. In response to determining that the vehicle can be controlled based on the real-time vehicle information, a vehicle control touch icon is generated based on the vehicle identifier; Real-time detection of touch operations received by the vehicle control touch icon, and generation of control commands corresponding to the vehicle control touch icon that received the touch operation; The vehicle is controlled to drive relative to other vehicles in the surrounding environment according to the control commands.
2. The human-machine interaction method for vehicle control according to claim 1, wherein, The vehicle identification includes the vehicle identification corresponding to the vehicle itself and the vehicle identification corresponding to the other vehicle; The step of generating a vehicle control touch icon based on the vehicle identifier includes: Set the vehicle icon as a vehicle control touch icon. The step of real-time detection of touch operations received by the vehicle control touch icon and generating control commands corresponding to the vehicle control touch icon that received the touch operation includes: In response to detecting that the touch operation received by the vehicle identifier, which serves as the vehicle control touch identifier, is a movement operation, the relative positional relationship between the vehicle identifier and the other vehicle identifier is obtained when the movement operation ends; Based on the relative positional relationship, corresponding control commands are generated.
3. The human-machine interaction method for vehicle control according to claim 2, wherein, The step of generating corresponding control commands based on the relative positional relationship includes: Determine whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; In response to determining that the vehicle identifier overlaps with the other vehicle identifier when the movement operation ends, the other vehicle corresponding to the other vehicle identifier that overlaps with the vehicle identifier when the movement operation ends is identified as the target vehicle; Generate control commands to control the vehicle to follow the target vehicle.
4. The human-machine interaction method for vehicle control according to claim 2, wherein, The step of generating corresponding control commands based on the relative positional relationship includes: Determine whether the vehicle identifier and the other vehicle identifier overlap when the movement operation ends; In response to determining that the vehicle identifier and the other vehicle identifier do not overlap when the movement operation ends, and that the other vehicle identifier is included between the start position and the end position of the movement operation, the other vehicle corresponding to the other vehicle identifier included between the start position and the end position is identified as the target vehicle. Generate control commands to control the vehicle to overtake the target vehicle.
5. The human-machine interaction method for vehicle control according to any one of claims 1 to 4, wherein, The vehicle identification includes the identification of the other vehicle corresponding to the other vehicle; The step of generating a vehicle control touch icon based on the vehicle identifier includes: Set the other vehicle identifier as a vehicle control touch identifier. The step of real-time detection of touch operations received by the vehicle control touch icon and generating control commands corresponding to the vehicle control touch icon that received the touch operation includes: In response to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is a preset vehicle control touch operation, the other vehicle corresponding to the other vehicle identifier that received the touch operation is identified as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle in accordance with the vehicle control mode corresponding to the vehicle control touch operation.
6. The human-machine interaction method for vehicle control according to claim 5, wherein, The vehicle control touch operation includes following vehicle touch operation; In response to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is a preset vehicle control touch operation, the other vehicle corresponding to the other vehicle identifier that received the touch operation is identified as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation, including: In response to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is the following touch operation, the other vehicle corresponding to the other vehicle identifier that received the touch operation is identified as the target vehicle, and a control command is generated to control the vehicle to follow the target vehicle.
7. The human-machine interaction method for vehicle control according to claim 5, wherein, The vehicle control touch operation includes the overtaking touch operation; In response to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is a preset vehicle control touch operation, the other vehicle corresponding to the other vehicle identifier that received the touch operation is identified as the target vehicle, and a control command is generated to control the vehicle to drive relative to the target vehicle according to the vehicle control mode corresponding to the vehicle control touch operation, including: In response to detecting that the touch operation received by the other vehicle identifier, which serves as the vehicle control touch identifier, is the overtaking touch operation, the other vehicle corresponding to the other vehicle identifier that received the touch operation is identified as the target vehicle, and a control command is generated to control the vehicle to overtake the target vehicle.
8. The human-machine interaction method for vehicle control according to any one of claims 1 to 7, wherein, The touch operations received by the vehicle control touch icon include following touch operations or overtaking touch operations; The real-time detection of touch operations received by the vehicle control touch icon includes: Real-time detection of the first touch operation received by the vehicle control touch icon; In response to the fact that no second touch operation of the same type as the first touch operation is received within a preset interval after the first touch operation is detected, the first touch operation is determined to be a touch operation received by the vehicle control touch identifier. In response to receiving a second touch operation of the same type as the first touch operation within a preset interval after detecting the first touch operation, the touch operation superimposed by the first touch operation and the second touch operation is determined as the touch operation received by the vehicle control touch identifier; Among them, one of the following touch operation and the overtaking touch operation is the first touch operation, and the other of the following touch operation and the overtaking touch operation is a touch operation that combines the first touch operation and the second touch operation.
9. The human-machine interaction method for vehicle control according to claim 8, wherein, The first touch operation and the second touch operation are click operations, while the following touch operation and the overtaking touch operation are click operations with different numbers of consecutive touches.
10. The human-machine interaction method for vehicle control according to claim 9, wherein, One of the following touch operation and the overtaking touch operation is a two-click operation, and the other of the following touch operation and the overtaking touch operation is a more than two-click operation.
11. The human-machine interaction method for vehicle control according to any one of claims 1 to 10, wherein, The vehicle identification includes the identification of the other vehicle corresponding to the other vehicle; The step of generating a vehicle control touch icon based on the vehicle identifier includes: A vehicle control icon, independent of the other vehicle icon, is generated around the other vehicle icon; wherein the vehicle control icon includes a following touch icon and / or an overtaking touch icon. The step of real-time detection of touch operations received by the vehicle control touch icon and generating control commands corresponding to the vehicle control touch icon that received the touch operation includes: The system detects in real time any touch operation received by either the following touch icon or the overtaking touch icon, identifies the other vehicle corresponding to the following touch icon or the overtaking touch icon that received the touch operation as the target vehicle, and generates a control command to control the vehicle to follow the target vehicle or to control the vehicle to overtake the target vehicle.
12. The human-machine interaction method for vehicle control according to any one of claims 1 to 10, wherein, The vehicle identification includes the touch-sensitive identifier for the other vehicle; The step of generating a vehicle control touch icon based on the vehicle identifier includes: The system detects touch operations received by the other vehicle's touch control icon in real time. In response to a touch operation that selects a vehicle control mode, it displays vehicle control icons, including a following touch control icon and / or an overtaking touch control icon. The vehicle control icons are configured to indicate the real-time vehicle control mode of the vehicle relative to the other vehicle. The step of real-time detection of touch operations received by the vehicle control touch icon and generating control commands corresponding to the vehicle control touch icon that received the touch operation includes: The system detects in real time any touch operation received by either the following touch icon or the overtaking touch icon, identifies the other vehicle corresponding to the following touch icon or the overtaking touch icon that received the touch operation as the target vehicle, and generates a control command to control the vehicle to follow the target vehicle or to control the vehicle to overtake the target vehicle.
13. A human-machine interface device for vehicle control, comprising: The display module is configured to acquire real-time perception data of the vehicle's surrounding environment, and generate and display vehicle identifiers corresponding to vehicles in the surrounding environment on the vehicle's intelligent driving perception screen based on the real-time perception data; wherein, the vehicle identifiers are configured to indicate real-time vehicle information in the surrounding environment. The generation module is configured to generate a vehicle control touch icon based on the vehicle identifier in response to determining that the vehicle can be controlled based on the real-time vehicle information. The touch module is configured to detect touch operations received by the vehicle control touch icon in real time and generate control commands corresponding to the vehicle control touch icon that received the touch operation; The control module is configured to control the vehicle to drive relative to other vehicles in the surrounding environment according to the control commands.
14. An electronic device comprising one or more processors configured to implement a human-machine interaction method for vehicle control as claimed in any one of claims 1 to 12.
15. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by at least one processor, implement the human-machine interaction method for vehicle control as described in any one of claims 1 to 12.
16. A computer program product comprising a computer program stored on a computer-readable storage medium, wherein when executed by at least one processor, the computer program implements a human-machine interaction method for vehicle control as described in any one of claims 1 to 12.
17. A vehicle comprising: The human-machine interface device for vehicle control as described in claim 13, or The electronic device as described in claim 14, or The non-transitory computer-readable storage medium as described in claim 15, or The computer program product as described in claim 16, or One or more processors, the one or more processors being configured to implement the human-machine interaction method for vehicle control as described in any one of claims 1 to 12.