Touch-controlled human-computer interaction method, device, electronic device, vehicle and storage medium

Abstract

The present application provides a touch-controlled human-computer interaction method, device, electronic device and storage medium, the method comprising: obtaining real-time perception data of the vehicle's perception device to perceive the surrounding environment of the vehicle; wherein the surrounding environment includes vehicles and lanes; based on the real-time perception data, generating and displaying touch indicators on the intelligent driving perception screen of the vehicle; the touch indicators include vehicle touch indicators corresponding to the vehicle and lane touch indicators corresponding to the lanes, each touch indicator is preset with a corresponding control object and control method; real-time detection of any one of the vehicle touch indicator and the lane touch indicator being touched, determining the control object and control method corresponding to the touched touch indicator as the target control object and target control method; according to the target control method, controlling the vehicle to travel relative to the target control object. The touch-controlled human-computer interaction method provided by the present application enables users to request the intelligent driving system to control the vehicle to travel as they wish through touch interaction.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a touch-controlled human-computer interaction method, device, electronic device, vehicle and storage medium. Background Art

[0002] In recent years, with the development of intelligent driving technology, more and more vehicles on the market have automatic driving functions. The realization of automatic driving functions depends on the vehicle's Advanced Driver Assistance System (ADAS). After the vehicle starts automatic driving, the Advanced Driver Assistance System can obtain real-time data about the vehicle's environment and make judgments based on preset intelligent driving strategies, and control the vehicle to follow traffic rules and drive safely to the destination along the planned route.

[0003] However, in the related technologies, most of the autonomous driving driving modes are preset. If the advanced driving assistance system controls the vehicle to drive according to the preset driving mode, the user will not be able to control the vehicle to drive according to his or her own wishes.

[0004] Therefore, it is necessary to provide a technical solution to solve the above technical problems. Summary of the invention

[0005] The present application provides a touch-controlled human-computer interaction method, device, electronic device, vehicle and storage medium, which can control the vehicle to travel according to the user's touch instructions.

[0006] In a first aspect, the present application provides a touch-controlled human-computer interaction method, comprising:

[0007] Acquire real-time perception data of the vehicle's surrounding environment perceived by the vehicle's perception device; wherein the surrounding environment includes the vehicle and the lane;

[0008] According to the real-time perception data, a touch mark is generated and displayed on the intelligent driving perception screen of the vehicle; wherein the touch mark includes a vehicle touch mark corresponding to the vehicle and a lane touch mark corresponding to the lane, and each touch mark is preset with a corresponding control object and control method;

[0009] detecting in real time that any one of the vehicle touch control indicator and the lane touch control indicator is touched, and determining the control object and the control method corresponding to the touched touch control indicator as a target control object and a target control method;

[0010] According to the target control method, the vehicle is controlled to travel relative to the target control object.

[0011] Optionally, the control object and the control method corresponding to the touch marker to be touched are determined as a target control object and a target control method, including:

[0012] If the vehicle touch mark is touched, a target vehicle is determined from the vehicles, and a vehicle control mode is determined according to the way in which the vehicle touch mark is touched;

[0013] The step of controlling the vehicle to travel relative to the target control object according to the target control method includes:

[0014] The self-vehicle is controlled to travel relative to the target vehicle according to the vehicle control method.

[0015] Optionally, the vehicle control mode includes a following mode; and controlling the self-vehicle to travel relative to the target vehicle according to the vehicle control mode includes:

[0016] According to the following vehicle mode, the self-vehicle is controlled to follow the target vehicle.

[0017] Optionally, the vehicle control mode includes an overtaking mode; and controlling the vehicle to travel relative to the target vehicle according to the vehicle control mode includes:

[0018] According to the overtaking method, the self-vehicle is controlled to overtake the target vehicle.

[0019] Optionally, the control object and the control method corresponding to the touch marker to be touched are determined as a target control object and a target control method, including:

[0020] If the lane touch mark is touched, determining a target lane from the lanes, and determining a lane control mode according to the way the lane touch mark is touched;

[0021] The step of controlling the vehicle to travel relative to the target control object according to the target control method includes:

[0022] The vehicle is controlled to travel in the target lane according to the lane control method.

[0023] Optionally, the lane control mode includes a lane change mode; and controlling the vehicle to travel in the target lane according to the lane control mode includes:

[0024] According to the lane changing method, the vehicle is controlled to change lanes to the target lane.

[0025] Optionally, the lane control mode includes a priority lane mode; and controlling the vehicle to travel in the target lane according to the lane control mode includes:

[0026] The vehicle is controlled to preferentially travel in the target lane.

[0027] Optionally, the lane control mode includes a lane locking mode; and controlling the vehicle to travel in the target lane according to the lane control mode includes:

[0028] The vehicle is controlled to lock and travel in the target lane.

[0029] Optionally, the surrounding environment further includes a parking position, and the touch mark further includes a parking touch mark corresponding to the parking position;

[0030] The real-time detection of any one of the vehicle touch indicator and the lane touch indicator being touched, and determining the control object and the control method corresponding to the touched touch indicator as a target control object and a target control method, includes:

[0031] detecting in real time whether any one of the parking touch control indicator, the vehicle touch control indicator and the lane touch control indicator is touched, and if the parking touch control indicator is touched, determining the parking position as a target control object and determining parking as a target control mode;

[0032] The step of controlling the vehicle to travel relative to the target control object according to the target control method includes:

[0033] The vehicle is controlled to park at the parking position.

[0034] Optionally, the vehicle includes a self-vehicle and an other vehicle, and the vehicle touch identifier includes a self-vehicle touch identifier corresponding to the self-vehicle and an other-vehicle touch identifier corresponding to the other vehicle;

[0035] The step of generating and displaying a touch mark on the intelligent driving perception screen of the vehicle includes:

[0036] Generate and display a lane touch mark corresponding to the lane;

[0037] Determine a first relative position between the ego vehicle and the ego lane where the ego vehicle is currently located, and generate and display the ego vehicle touch mark corresponding to the ego vehicle at the first relative position of the lane touch mark corresponding to the ego lane according to a preset display ratio;

[0038] A second relative position between the other vehicle and the own vehicle is determined, and an other vehicle touch control mark corresponding to the other vehicle is generated and displayed at the second relative position of the own vehicle touch control mark according to the display ratio.

[0039] Optionally, after generating and displaying the lane touch mark corresponding to the lane, the touch-controlled human-computer interaction method further includes:

[0040] If it is detected that the lane touch indicator is touched, at least one lane control mode is generated and displayed.

[0041] Optionally, if it is detected that the lane touch indicator is touched, generating and displaying at least one lane control mode includes:

[0042] When it is detected that the lane touch control indicator is touched in a touch control mode for selecting lane control, at least one lane control touch indicator for indicating different lane control modes is generated and displayed.

[0043] Optionally, after generating and displaying the other vehicle touch identification corresponding to the other vehicle, the touch-controlled human-computer interaction method further includes:

[0044] If it is detected that the other vehicle touch mark is touched, at least one vehicle control mode is generated and displayed.

[0045] Optionally, if it is detected that the touch mark of the other vehicle is touched, generating and displaying at least one vehicle control mode includes:

[0046] When it is detected that the other-vehicle touch control indicator is touched in a touch control mode for selecting vehicle control, at least one vehicle control touch control indicator for indicating different vehicle control modes is generated and displayed.

[0047] Optionally, after generating and displaying the vehicle touch identification corresponding to the vehicle, the touch-controlled human-computer interaction method further includes:

[0048] Determining whether the distance between one side of the vehicle and the boundary of the corresponding side of the lane is greater than a preset safety distance;

[0049] If yes, a direction touch mark pointing to the corresponding side boundary of the lane is generated and displayed on the side of the vehicle touch mark; wherein the direction touch mark can be touched to indicate that the position of the vehicle is allowed to be adjusted in the direction pointed by the direction touch mark;

[0050] If not, a direction indication mark pointing to the corresponding side boundary of the lane is generated and displayed on the side of the vehicle touch mark; wherein the direction indication mark is not touchable and is used to indicate that it is prohibited to adjust the position of the vehicle in the direction it points to.

[0051] Optionally, after generating and displaying the vehicle touch identification corresponding to the vehicle, the touch-controlled human-computer interaction method further includes:

[0052] A direction touch mark pointing to the rear of the self-vehicle touch mark is generated and displayed behind the self-vehicle touch mark; wherein the direction touch mark can be touched to indicate that the position of the self-vehicle can be adjusted in the direction pointed by the direction touch mark;

[0053] Determine whether the distance between the front of the vehicle and the rear of the other vehicle in front of the vehicle is greater than a preset safety distance;

[0054] If yes, generating and displaying the direction touch mark pointing to the front of the own vehicle touch mark in front of the own vehicle touch mark;

[0055] If not, a direction indication mark pointing in front of the vehicle touch mark is generated and displayed in front of the vehicle touch mark; wherein the direction indication mark is not touchable and is used to indicate that it is prohibited to adjust the position of the vehicle in the direction it points to.

[0056] Optionally, the lane touch control markers corresponding to all the lanes are arranged side by side, and the lane touch control marker corresponding to the own lane is located below the own vehicle touch control marker.

[0057] In a second aspect, the present application provides a touch-controlled human-computer interaction device, comprising:

[0058] An acquisition module, used to acquire real-time perception data of the surrounding environment of the vehicle perceived by the vehicle's perception device; wherein the surrounding environment includes the vehicle and the lane;

[0059] A generation module, configured to generate and display a touch mark on the intelligent driving perception screen of the vehicle according to the real-time perception data; wherein the touch mark includes a vehicle touch mark corresponding to the vehicle and a lane touch mark corresponding to the lane, and each of the touch marks is preset with a corresponding control object and control method;

[0060] A touch control module, used for detecting in real time whether any one of the vehicle touch control mark and the lane touch control mark is touched, and determining the control object and the control mode corresponding to the touched touch control mark as a target control object and a target control mode;

[0061] The control module is used to control the vehicle to travel relative to the target control object according to the target control method.

[0062] In a third aspect, the present application provides an electronic device, comprising at least one processor, wherein the processor is used to implement the touch-controlled human-computer interaction method as described in any one of the first aspects.

[0063] In a fourth aspect, the present application provides a vehicle, comprising at least one processor, wherein the processor is used to implement the touch-controlled human-computer interaction method as described in any one of the first aspects.

[0064] In a fifth aspect, the present application provides a computer-readable storage medium having a program stored thereon, and when the program is executed by a processor, the touch-controlled human-computer interaction method as described in any one of the first aspects is implemented.

[0065] In the touch-type human-computer interaction method, device, electronic device, vehicle and storage medium provided by the present application, a vehicle touch mark corresponding to the vehicle in the surrounding environment of the vehicle and a lane touch mark corresponding to the lane are generated and displayed on the intelligent driving perception screen of the vehicle, and the user's touch operation is detected in real time to determine the target control object and the target control method, and the vehicle is controlled to travel relative to the target control object according to the target control method, thereby providing a touch interaction method between the user and the intelligent driving system, so that the user can request the intelligent driving system to control the vehicle to travel according to his own wishes through touch interaction. In addition, since the vehicle touch mark and the lane touch mark correspond to the vehicle and the lane in the surrounding environment respectively, the user can timely and accurately grasp the information of the surrounding environment by viewing the intelligent driving perception screen of the vehicle, without having to observe and analyze the surrounding environment of the vehicle by himself, reducing the safety risks caused by the user's distracted thinking. BRIEF DESCRIPTION OF THE DRAWINGS

[0066] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0067] Figure 1 Shown is a schematic diagram of a scenario to which the touch-controlled human-computer interaction method according to an embodiment of the present application is applicable.

[0068] Figure 2 FIG. 1 is a flow chart of a touch-controlled human-computer interaction method according to an embodiment of the present application.

[0069] Figure 3 Shown is a schematic diagram of an electronic image according to an embodiment of the present application.

[0070] Figure 4 Shown is a structural block diagram of a touch-controlled human-computer interaction device according to an embodiment of the present application.

[0071] Figure 5 Shown is a structural block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0072] Here, the technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements.

[0073] The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with one or more embodiments of this specification. Instead, they are merely examples of devices and methods consistent with some aspects of one or more embodiments of this specification as detailed in the attached claims. It should be noted that in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the steps included in the method may be more or less than those described in this specification. In addition, a single step described in this specification may be decomposed into multiple steps for description in other embodiments; and multiple steps described in this specification may be combined into a single step for description in other embodiments.

[0074] In the related art, in vehicles with autonomous driving functions, the advanced driving assistance system usually controls the vehicle to drive according to a preset driving mode, making it impossible for users to control the vehicle to drive according to their own wishes.

[0075] In order to solve the technical problem in the related art that the user cannot control the vehicle to drive as he or she wishes when the vehicle is automatically driving, the embodiment of the present application provides a touch-based human-computer interaction method, which generates and displays vehicle touch markers corresponding to vehicles in the surrounding environment of the vehicle and lane touch markers corresponding to lanes on the vehicle's intelligent driving perception screen, and detects the user's touch operation in real time, determines the target control object and the target control method, and controls the vehicle to drive relative to the target control object according to the target control method, thereby providing a touch interaction method between the user and the intelligent driving system, so that the user can request the intelligent driving system to control the vehicle to drive as he or she wishes through touch interaction.

[0076] In addition, in the related art, when driving a vehicle, the user needs to observe the surrounding environment of the vehicle with the naked eye and analyze the observed surrounding environment of the vehicle based on his own driving experience to make accurate driving judgments, thereby controlling the vehicle to drive according to his own wishes. However, in actual scenarios, the surrounding environment of the vehicle is very complex, resulting in rapidly changing road conditions. Users must not only observe the surrounding environment of the vehicle, but also analyze the surrounding environment of the vehicle. The process of user distraction is prone to safety risks.

[0077] In order to solve the technical problem in the related technology that users need to observe and analyze the vehicle's surroundings to make driving decisions and reduce the safety risks caused by users' distracted thinking, the embodiment of the present application provides a touch-based human-computer interaction method, in which the vehicle touch logo and lane touch logo displayed on the vehicle's intelligent driving perception screen respectively correspond to the vehicles and lanes in the vehicle's surroundings, so that users can timely and accurately grasp the information of their own vehicle's surroundings by viewing the vehicle's intelligent driving perception screen, without having to observe and analyze the vehicle's surroundings by themselves, thereby reducing the safety risks caused by users' distracted thinking.

[0078] See also Figure 1 , Figure 1 The diagram is a schematic diagram of a scenario in which the touch-controlled human-computer interaction method provided in the embodiment of the present application is applicable. The touch-controlled human-computer interaction method provided in the embodiment of the present application can be applied to a vehicle 10 having an intelligent driving system. The vehicle 10 may include a touch screen 11 and an electronic device connected to the touch screen 11. The electronic device may be, but is not limited to, a controller or a processor. The controller may include, but is not limited to, a body controller, a domain controller, and other devices, which are not listed one by one here. It should be noted that the vehicle 10 may also include Figure 1 For the introduction of other components not shown in the figure, please refer to the relevant description in the automotive field, which will not be described in detail here.

[0079] Please also read Figure 2 , Figure 2 The figure is a flow chart of the touch-controlled human-computer interaction method provided in the embodiment of the present application. The touch-controlled human-computer interaction method provided in the embodiment of the present application includes but is not limited to the following steps S101 to S104.

[0080] S101, obtaining real-time perception data of the vehicle's surrounding environment perceived by the vehicle's perception device; wherein the surrounding environment includes the vehicle and lanes.

[0081] The intelligent driving system can sense the surrounding environment of the vehicle in real time during driving through various sensors installed on the vehicle (such as millimeter wave radar, laser radar, single / binocular camera and satellite navigation, etc.), obtain real-time perception data of the surrounding environment of the vehicle, identify, detect and track static and dynamic objects based on the real-time perception data, and perform systematic calculations and analysis in combination with navigation map data, so as to make users aware of possible dangers in advance and effectively improve the comfort and safety of vehicle driving. Here, the vehicle's perception equipment can be various sensors installed on the vehicle. The intelligent driving system obtains real-time perception data of the surrounding environment of the vehicle from various sensors on the vehicle, and controls the vehicle to follow traffic rules and drive safely to the destination along the planned route.

[0082] The surrounding environment of the vehicle may include lanes and vehicles on the road, the vehicles include the vehicle and other vehicles, and the lanes include the vehicle's own lane and other lanes where the vehicle is not.

[0083] S102, based on the real-time perception data, generate and display a touch mark on the intelligent driving perception screen of the vehicle; wherein the touch mark includes a vehicle touch mark corresponding to the vehicle and a lane touch mark corresponding to the lane, and each touch mark is preset with a corresponding control object and control method.

[0084] The vehicle's sensing device serves as the "eyes and ears" of the intelligent driving system. The intelligent driving system can indirectly sense the surrounding environment of the vehicle by acquiring the real-time sensing data of the vehicle's sensing device sensing the surrounding environment of the vehicle. After acquiring the real-time sensing data of the vehicle's sensing device sensing the surrounding environment of the vehicle, in order to show the user the surrounding environment of the vehicle and facilitate the user to grasp the information of the surrounding environment of the vehicle in real time, the intelligent driving system can generate and display an electronic image of the surrounding environment of the vehicle on the Advanced Driver Assistance System View (ADV) of the vehicle. The electronic image contains touch markers, each of which is preset with a corresponding control object and control method. The user can control the vehicle to drive relative to the specified control object in a specified control method by touching the touch marker in the electronic image.

[0085] The electronic image may include a vehicle identification and a lane identification. Among them: the vehicle identification is an identification corresponding to a vehicle in the surrounding environment of the own vehicle, which may include an identification corresponding to the own vehicle and an identification corresponding to another vehicle, and is used to indicate real-time vehicle information in the surrounding environment; the lane identification is an identification corresponding to a lane in the surrounding environment of the own vehicle, which may include an identification corresponding to the own lane where the own vehicle is located and an identification corresponding to another lane where the own vehicle is not located, and is used to indicate real-time lane information in the surrounding environment.

[0086] Please also read Figure 3 , Figure 3 The electronic image of the embodiment of the present application is shown as a schematic diagram. The electronic image includes the vehicle identification, the other vehicle identification and the lane identification. The other vehicle identification may include the other vehicle graphic and / or the other vehicle number. The lane identification may include the lane graphic and / or the lane number. Figure 3 The electronic images shown are described in detail.

[0087] Lane markings include lane graphics and lane numbers ①, ②, ③ and ④. Among them: a solid line and a dotted line in the longitudinal direction constitute the lane graphics of the rightmost lane (lane ①) in the same direction, two dotted lines in the longitudinal direction constitute the lane graphics of the middle lane (lane ②) in the same direction, a dotted line and a solid line in the longitudinal direction constitute the lane graphics of the leftmost lane (lane ③) in the same direction, and a dotted line and a solid line in the longitudinal direction constitute the lane graphics of the leftmost lane (lane ④) in the opposite direction.

[0088] The other vehicle identification includes the other vehicle graphic and the other vehicle number A, B, C, D. Among them: Vehicle A, Vehicle B and Vehicle C are vehicles traveling in the same direction in lane ①, lane ② and lane ③ respectively, and Vehicle D is a vehicle traveling in the opposite direction in lane ④.

[0089] Setting the lane marker as a touchable marker forms a lane touch marker. The lane touch marker may include a touchable lane graphic and / or a touchable lane number. Compared to the lane marker, the lane touch marker is used not only to indicate the real-time lane information in the surrounding environment of the vehicle, but also to receive the user's touch operation. The user can specify the lane by touching the lane touch marker in the electronic image. When the lane touch marker includes a touchable lane graphic, in order to facilitate the user to touch the lane touch marker, the entire lane graphic can be set to be touchable, so that the user can touch any position of the lane graphic without having to precisely touch a certain place of the lane graphic.

[0090] Setting the vehicle identification as a touchable identification forms a vehicle touch identification. The vehicle touch identification may include the vehicle touch identification and / or the other vehicle touch identification. Compared with the vehicle identification, the vehicle touch identification can be used to indicate the real-time vehicle information in the surrounding environment of the vehicle, and can also be used to receive the user's touch operation. The user can specify the vehicle by touching the vehicle touch identification in the electronic image.

[0091] It should be noted that Figure 3 In the electronic image shown, the vehicle logo is black, the other vehicle logos of cars B and C are white, the other vehicle logos of cars A and D are gray, the lane graphics of lanes ①, ②, and ③ are white, and the lane graphics of lane ④ is gray ( Figure 3) Wherein: a white other vehicle logo indicates that the current self-vehicle can perform at least one vehicle control method (such as overtaking or following) relative to the other vehicle represented by the other vehicle logo, and a gray other vehicle logo indicates that the current self-vehicle cannot perform any vehicle control method relative to the other vehicle represented by the other vehicle logo; similarly, a white lane graphic indicates that the current self-vehicle can perform at least one lane control method (such as changing lanes) relative to the lane represented by the lane graphic, and a gray lane graphic indicates that the current self-vehicle cannot perform any lane control method relative to the lane represented by the lane graphic. In a specific scenario, the colors of the other vehicle logos corresponding to different other vehicles and the lane graphics corresponding to different lanes can be specifically set, and the colors of the lane numbers corresponding to different lanes can also be different. For example, the self-vehicle logo can be set to the real color of the self-vehicle, the other vehicle logo on which at least one vehicle control method can be performed can be set to green, and the other vehicle logo on which no vehicle control method can be performed can be set to red. The embodiment of the present application does not limit the specific colors of different lane logos, different other vehicle logos, and self-vehicle logos.

[0092] It should also be noted that the touch indicators included in the electronic image are not limited to the vehicle touch indicators and the lane touch indicators, but may also include other touch indicators. For example, the touch indicators may also include location touch indicators, and the user may also control the vehicle to travel to the location corresponding to the location touch indicator by touching the location touch indicator.

[0093] S103, detecting in real time whether any one of the vehicle touch indicator and the lane touch indicator is touched, and determining the control object and control method corresponding to the touched touch indicator as the target control object and the target control method.

[0094] When the user performs a touch operation on any of the vehicle touch logo and the lane touch logo, the vehicle touch logo or the lane touch logo will receive the touch operation. After detecting that the vehicle touch logo or the lane touch logo is touched, the intelligent driving system will determine the control object corresponding to the touched vehicle touch logo or lane touch logo as the target control object, and determine the control method corresponding to the touched vehicle touch logo or lane touch logo as the target control method. Among them, the target control object is usually another vehicle or a lane, and the target control method is usually a vehicle control method (such as overtaking, following a vehicle, or locking a vehicle, etc.) or a lane control method (such as changing lanes, priority lanes, or locking lanes, etc.).

[0095] S104, controlling the vehicle to travel relative to the target control object according to the target control method.

[0096] After determining the target control object and the target control method, the intelligent driving system controls the vehicle to travel relative to the target control object according to the target control method, thereby responding to the user's touch operation, and controlling the vehicle to travel relative to the other vehicle specified by the user according to the vehicle control method specified by the user, or controlling the vehicle to travel in the lane specified by the user according to the lane control method specified by the user.

[0097] In some embodiments:

[0098] When the control object and control mode corresponding to the touched touch mark in the above step S103 are determined as the target control object and the target control mode, the following steps are specifically included:

[0099] If the vehicle touch mark is touched, a target vehicle is determined from the vehicles, and a vehicle control method is determined according to the way the vehicle touch mark is touched;

[0100] In the above step S104, when the vehicle is controlled to travel relative to the target control object according to the target control method, the following steps are specifically included:

[0101] The self-vehicle is controlled to travel relative to the target vehicle according to the vehicle control method.

[0102] In some embodiments, the vehicle control method in the above steps includes a vehicle following method;

[0103] In the above steps, when controlling the self-vehicle to travel relative to the target vehicle according to the vehicle control method, the steps specifically include the following steps:

[0104] According to the following vehicle mode, the self-vehicle is controlled to follow the target vehicle.

[0105] In some embodiments, the vehicle control method in the above steps includes an overtaking method;

[0106] In the above steps, when controlling the self-vehicle to travel relative to the target vehicle according to the vehicle control method, the steps specifically include the following steps:

[0107] According to the overtaking method, the vehicle is controlled to overtake the target vehicle.

[0108] In some embodiments:

[0109] When the control object and control mode corresponding to the touched touch mark in the above step S103 are determined as the target control object and the target control mode, the following steps are specifically included:

[0110] If the lane touch control mark is touched, a target lane is determined from the lanes, and a lane control mode is determined according to the way the lane touch control mark is touched;

[0111] In the above step S104, when the vehicle is controlled to travel relative to the target control object according to the target control method, the following steps are specifically included:

[0112] The vehicle is controlled to travel in the target lane according to the lane control method.

[0113] In some embodiments, the lane control method in the above steps includes a lane change method;

[0114] In the above steps, when the vehicle is controlled to travel in the target lane according to the lane control method, the steps specifically include the following steps:

[0115] According to the lane changing method, the vehicle is controlled to change lanes to the target lane.

[0116] In some embodiments, the lane control method in the above steps includes a priority lane method;

[0117] In the above steps, when the vehicle is controlled to travel in the target lane according to the lane control method, the steps specifically include the following steps:

[0118] Control the vehicle to drive in the target lane first.

[0119] In some embodiments, the lane control method in the above steps includes a lane locking method;

[0120] In the above steps, when the vehicle is controlled to travel in the target lane according to the lane control method, the steps specifically include the following steps:

[0121] Control the vehicle to lock in the target lane.

[0122] In some embodiments, the surrounding environment in the above steps also includes a parking position, and the touch mark in the above steps also includes a parking touch mark corresponding to the parking position;

[0123] In the above step S103, when the vehicle touch indicator and the lane touch indicator are detected in real time and the control object and control mode corresponding to the touched touch indicator are determined as the target control object and the target control mode, the following steps are specifically included:

[0124] detecting in real time whether any one of the parking touch control mark, the vehicle touch control mark and the lane touch control mark is touched, and if the parking touch control mark is touched, determining the parking position as a target control object and determining parking as a target control mode;

[0125] In the above step S104, when the vehicle is controlled to travel relative to the target control object according to the target control method, the following steps are specifically included:

[0126] Control the vehicle to park at the parking position.

[0127] In some embodiments, the vehicle in the above steps includes the own vehicle and the other vehicle, and the vehicle touch identification in the above steps includes the own vehicle touch identification corresponding to the own vehicle and the other vehicle touch identification corresponding to the other vehicle;

[0128] When the touch mark is generated and displayed on the intelligent driving perception screen of the vehicle in the above step S102, the following steps are specifically included:

[0129] Generate and display lane touch signs corresponding to lanes;

[0130] Determine a first relative position between the vehicle and the lane in which the vehicle is currently located, and generate and display a vehicle touch marker corresponding to the vehicle at the first relative position of the lane touch marker corresponding to the lane according to a preset display ratio;

[0131] A second relative position between the other vehicle and the own vehicle is determined, and an other vehicle touch marker corresponding to the other vehicle is generated and displayed at the second relative position of the own vehicle touch marker according to the display ratio.

[0132] In some embodiments, the lane touch markers corresponding to all lanes are arranged side by side, and the lane touch marker corresponding to the own lane is located below the own vehicle touch marker.

[0133] In some embodiments, after the lane touch mark corresponding to the lane is generated and displayed in the above steps, the touch-controlled human-computer interaction method of the embodiment of the present application further includes the following steps:

[0134] If it is detected that the lane touch control mark is touched, at least one lane control mode is generated and displayed.

[0135] In some embodiments, if it is detected in the above steps that the lane touch indicator is touched, generating and displaying at least one lane control mode specifically includes the following steps:

[0136] When it is detected that the lane touch control indicator is touched in a touch control mode for selecting lane control, at least one lane control touch control indicator for indicating different lane control modes is generated and displayed.

[0137] In some embodiments, after the other vehicle touch identification corresponding to the other vehicle is generated and displayed in the above steps, the touch-controlled human-computer interaction method of the embodiment of the present application further includes the following steps:

[0138] If it is detected that the other vehicle touch mark is touched, at least one vehicle control mode is generated and displayed.

[0139] In some embodiments, in the above steps, if it is detected that the other vehicle touch indicator is touched, generating and displaying at least one vehicle control mode specifically includes the following steps:

[0140] When it is detected that the other-vehicle touch control indicator is touched in a touch control mode for selecting vehicle control, at least one vehicle control touch control indicator for indicating different vehicle control modes is generated and displayed.

[0141] In some embodiments, after the vehicle touch identification corresponding to the vehicle is generated and displayed in the above steps, the touch-controlled human-computer interaction method of the embodiment of the present application further includes the following steps:

[0142] Determine whether the distance between one side of the vehicle and the boundary of the corresponding side of the lane is greater than a preset safety distance;

[0143] If yes, a direction touch mark pointing to the boundary of the corresponding side of the lane is generated and displayed on the side of the ego vehicle touch mark; wherein the direction touch mark can be touched to indicate that the position of the ego vehicle is allowed to be adjusted in the direction pointed by the direction touch mark;

[0144] If not, a direction indication mark pointing to the boundary of the corresponding side of the lane is generated and displayed on the side of the vehicle touch mark; wherein the direction indication mark is not touchable and is used to indicate that it is prohibited to adjust the position of the vehicle in the direction it points to.

[0145] In some embodiments, after the vehicle touch identification corresponding to the vehicle is generated and displayed in the above steps, the touch-controlled human-computer interaction method of the embodiment of the present application further includes the following steps:

[0146] A direction touch mark pointing to the rear of the vehicle touch mark is generated and displayed behind the vehicle touch mark; wherein the direction touch mark can be touched to indicate that the position of the vehicle is allowed to be adjusted in the direction pointed by the direction touch mark;

[0147] Determine whether the distance between the front of the vehicle and the rear of the other vehicle in front of the vehicle is greater than a preset safety distance;

[0148] If yes, then generating and displaying the direction touch mark pointing to the front of the own vehicle touch mark in front of the own vehicle touch mark;

[0149] If not, a direction indication mark pointing to the front of the own vehicle touch mark is generated and displayed in front of the own vehicle touch mark; wherein the direction indication mark is not touchable and is used to indicate that it is prohibited to adjust the position of the own vehicle in the direction it points to.

[0150] Among them, the attributes of the direction touch logo are different from the attributes of the direction indication logo. For example: the direction touch logo can be set to one color and the direction indication logo can be set to another color, and the difference between the direction touch logo and the direction indication logo can be reflected by the difference in color; the direction touch logo can also be generated by a solid line and a direction indication logo can be generated by a dotted line, and the difference between the direction touch logo and the direction indication logo can be reflected by the difference in real and virtual; a larger direction touch logo can also be generated and a smaller direction indication logo can be generated, and the difference between the direction touch logo and the direction indication logo can be reflected by the difference in size. The embodiment of the present application does not limit the specific form of expression of the difference between the direction touch logo and the direction indication logo, as long as the attributes of the direction touch logo and the direction indication logo are different.

[0151] The present application also provides a touch-controlled human-computer interaction device. Figure 4 , Figure 4 The structure diagram of the touch-controlled human-computer interaction device provided in the embodiment of the present application is shown. The touch-controlled human-computer interaction device 21 provided in the embodiment of the present application may include:

[0152] The acquisition module 211 is used to acquire real-time perception data of the surrounding environment of the vehicle perceived by the perception device of the vehicle; wherein the surrounding environment includes the vehicle and the lane;

[0153] A generating module 212 is used to generate and display a touch mark on the intelligent driving perception screen of the vehicle according to the real-time perception data; wherein the touch mark includes a vehicle touch mark corresponding to the vehicle and a lane touch mark corresponding to the lane, and each touch mark is preset with a corresponding control object and control method;

[0154] The touch control module 213 is used to detect in real time whether any one of the vehicle touch control mark and the lane touch control mark is touched, and determine the control object and control mode corresponding to the touched touch control mark as the target control object and target control mode;

[0155] The control module 214 is used to control the vehicle to travel relative to the target control object according to the target control method.

[0156] The implementation process of the functions and effects of each module in the above-mentioned device is specifically described in the implementation process of the corresponding steps in the above-mentioned method, and the same technical effect can be achieved, which will not be repeated here.

[0157] In some embodiments:

[0158] When the control object and control mode corresponding to the touched touch mark are determined as the target control object and the target control mode, the touch module 213 is specifically used to: if the touched object is the vehicle touch mark, determine the target vehicle from the vehicles, and determine the vehicle control mode according to the way the vehicle touch mark is touched;

[0159] When the control module 214 controls the vehicle to travel relative to the target control object according to the target control method, it is specifically used to: control the vehicle to travel relative to the target vehicle according to the vehicle control method.

[0160] In some embodiments, the above-mentioned vehicle control method includes a following vehicle method; when the control module 214 controls the vehicle to travel relative to the target vehicle according to the vehicle control method, it is specifically used to: control the vehicle to follow the target vehicle according to the following vehicle method.

[0161] In some embodiments, the above-mentioned vehicle control method includes an overtaking method; when the control module 214 controls the vehicle to travel relative to the target vehicle according to the vehicle control method, it is specifically used to: control the vehicle to overtake the target vehicle according to the overtaking method.

[0162] In some embodiments:

[0163] When the control object and control mode corresponding to the touched touch mark are determined as the target control object and the target control mode, the touch module 213 is specifically used to: if the touched object is the lane touch mark, determine the target lane from the lanes, and determine the lane control mode according to the way the lane touch mark is touched;

[0164] When the control module 214 controls the vehicle to travel relative to the target control object according to the target control method, it is specifically used to control the vehicle to travel in the target lane according to the lane control method.

[0165] In some embodiments, the above-mentioned lane control method includes a lane changing method; when the control module 214 controls the vehicle to travel in the target lane according to the lane control method, it is specifically used to: control the vehicle to change lanes to the target lane according to the lane changing method.

[0166] In some embodiments, the lane control method includes a priority lane method; when the control module 214 controls the vehicle to drive in the target lane according to the lane control method, it is specifically used to: control the vehicle to drive in the target lane with priority.

[0167] In some embodiments, the lane control method includes a lane locking method; when the control module 214 controls the vehicle to travel in the target lane according to the lane control method, it is specifically used to: control the vehicle to lock and travel in the target lane.

[0168] In some embodiments, the surrounding environment further includes a parking position, and the touch mark further includes a parking touch mark corresponding to the parking position;

[0169] When the touch module 213 detects in real time that any one of the vehicle touch indicator and the lane touch indicator is touched, and determines the control object and control mode corresponding to the touched touch indicator as the target control object and the target control mode, it is specifically used to: detect in real time that any one of the parking touch indicator, the vehicle touch indicator and the lane touch indicator is touched, and if the touched one is the parking touch indicator, determine the parking position as the target control object and determine parking as the target control mode;

[0170] When the control module 214 controls the vehicle to travel relative to the target control object according to the target control method, it is specifically used to control the vehicle to park at the parking position.

[0171] In some embodiments, the above-mentioned vehicle includes a self-vehicle and an other vehicle, and the above-mentioned vehicle touch identification includes a self-vehicle touch identification corresponding to the self-vehicle and an other vehicle touch identification corresponding to the other vehicle;

[0172] When the generation module 212 generates and displays the touch logo on the intelligent driving perception screen of the own vehicle, it is specifically used to: generate and display the lane touch logo corresponding to the lane; determine the first relative position between the own vehicle and the own lane in which the own vehicle is currently located, and generate and display the own vehicle touch logo corresponding to the own vehicle at the first relative position of the lane touch logo corresponding to the own lane according to a preset display ratio; determine the second relative position between the other vehicle and the own vehicle, and generate and display the other vehicle touch logo corresponding to the other vehicle at the second relative position of the own vehicle touch logo according to the display ratio.

[0173] In some embodiments, after generating and displaying the lane touch control mark corresponding to the lane, the generation module 212 is further configured to: if it is detected that the lane touch control mark is touched, generate and display at least one lane control method.

[0174] In some embodiments, when the generation module 212 detects that the lane touch control indicator is touched, it generates and displays at least one lane control mode. Specifically, when it is detected that the lane touch control indicator is touched in a touch mode for selecting lane control, it generates and displays at least one lane control touch indicator for indicating different lane control modes.

[0175] In some embodiments, after generating and displaying the vehicle touch marker corresponding to the vehicle, the generation module 212 is also used to: determine whether the distance between one side of the vehicle and the boundary of the corresponding side of the lane is greater than a preset safety distance; if so, generate and display a direction touch marker pointing to the boundary of the corresponding side of the lane on the side of the vehicle touch marker; wherein the direction touch marker can be touched to indicate that the position of the vehicle can be adjusted in the direction indicated by it; if not, generate and display a direction indication marker pointing to the boundary of the corresponding side of the lane on the side of the vehicle touch marker; wherein the direction indication marker is not touchable to indicate that the position of the vehicle can be adjusted in the direction indicated by it.

[0176] In some embodiments, after generating and displaying the other vehicle touch control mark corresponding to the other vehicle, the generation module 212 is further configured to: if it is detected that the other vehicle touch control mark is touched, generate and display at least one vehicle control method.

[0177] In some embodiments, when the generation module 212 detects that the touch control indicator of the other vehicle is touched, it generates and displays at least one vehicle control method. Specifically, when it is detected that the touch control indicator of the other vehicle is touched in a touch control method for selecting vehicle control, it generates and displays at least one vehicle control touch indicator for indicating different vehicle control methods.

[0178] In some embodiments, after generating and displaying the other vehicle touch marker corresponding to the other vehicle, the generation module 212 is further used to: generate and display a direction touch marker pointing to the rear of the own vehicle touch marker behind the own vehicle touch marker; wherein the direction touch marker can be touched to indicate that it is allowed to adjust the position of the own vehicle in the direction it points to; determine whether the distance between the front of the own vehicle and the rear of the other vehicle in front of the own vehicle is greater than a preset safe vehicle distance; if so, generate and display the direction touch marker pointing to the front of the own vehicle touch marker in front of the own vehicle touch marker; if not, generate and display a direction indication marker pointing to the front of the own vehicle touch marker in front of the own vehicle touch marker; wherein the direction indication marker is not touchable to indicate that it is prohibited to adjust the position of the own vehicle in the direction it points to.

[0179] The present application also provides an electronic device, which may include the above-mentioned touch-type human-computer interaction device 21. Figure 5 , Figure 5 The electronic device 20 may include one or more processors 22, and the processor 22 is used to implement the above-mentioned touch-type human-computer interaction method.

[0180] In some embodiments, the electronic device 20 may include a computer-readable storage medium 23, which may store a program that can be called by the processor 22 and may include a non-volatile storage medium. In other embodiments, the electronic device 20 may also include a memory 24 and an interface 25. In other embodiments, the electronic device 20 may also include other hardware according to actual applications.

[0181] The computer-readable storage medium 23 provided in the embodiment of the present application stores a program thereon, and when the program is executed by the processor 22, it is used to implement the above-mentioned touch-type human-computer interaction method.

[0182] The present application may take the form of a computer program product implemented on one or more computer-readable storage media 23 (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing program code. The computer-readable storage medium 23 includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information can be a computer-readable instruction, a data structure, a module of a program, or other data. The computer-readable storage medium 23 includes but is not limited to: phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk read-only memory (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassette, tape disk storage or other magnetic storage device or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0183] The above description is only a preferred embodiment of this specification and is not intended to limit this specification. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of this specification should be included in the scope of protection of this specification.

[0184] It should also be noted that the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of more restrictions, the phrase "includes a ..." defines an element, and does not exclude the presence of other identical elements in the process, method, commodity or device including the element.

Claims

1. A touch-controlled human-computer interaction method, characterized in that: include: Acquire real-time perception data of the vehicle's surrounding environment perceived by the vehicle's perception device; wherein the surrounding environment includes the vehicle and the lane; According to the real-time perception data, a touch mark is generated and displayed on the intelligent driving perception screen of the vehicle; wherein the touch mark includes a vehicle touch mark corresponding to the vehicle and a lane touch mark corresponding to the lane, and each of the touch marks is preset with a corresponding control object and control mode; the touch-type human-computer interaction method further includes: if it is detected that the lane touch mark is touched, generating and displaying at least one lane control mode; detecting in real time that any one of the vehicle touch control indicator and the lane touch control indicator is touched, and determining the control object and the control method corresponding to the touched touch control indicator as a target control object and a target control method; According to the target control method, the vehicle is controlled to travel relative to the target control object.

2. The touch-controlled human-computer interaction method according to claim 1, characterized in that: The control object and the control method corresponding to the touch mark to be touched are determined as the target control object and the target control method, including: If the vehicle touch mark is touched, a target vehicle is determined from the vehicles, and a vehicle control mode is determined according to the way in which the vehicle touch mark is touched; The step of controlling the vehicle to travel relative to the target control object according to the target control method includes: The self-vehicle is controlled to travel relative to the target vehicle according to the vehicle control method.

3. The touch-controlled human-computer interaction method according to claim 2, characterized in that: The vehicle control mode includes a following mode; and controlling the self-vehicle to travel relative to the target vehicle according to the vehicle control mode includes: According to the following vehicle mode, the self-vehicle is controlled to follow the target vehicle.

4. The touch-controlled human-computer interaction method according to claim 2, characterized in that: The vehicle control mode includes an overtaking mode; and controlling the vehicle to travel relative to the target vehicle according to the vehicle control mode includes: According to the overtaking method, the self-vehicle is controlled to overtake the target vehicle.

5. The touch-controlled human-computer interaction method according to claim 1, characterized in that: The control object and the control method corresponding to the touch mark to be touched are determined as the target control object and the target control method, including: If the lane touch mark is touched, determining a target lane from the lanes, and determining a lane control mode according to the way the lane touch mark is touched; The step of controlling the vehicle to travel relative to the target control object according to the target control method includes: The vehicle is controlled to travel in the target lane according to the lane control method.

6. The touch-controlled human-computer interaction method according to claim 5, characterized in that: The lane control method includes a lane change method; and controlling the vehicle to travel in the target lane according to the lane control method includes: According to the lane changing method, the vehicle is controlled to change lanes to the target lane.

7. The touch-controlled human-computer interaction method according to claim 5, characterized in that: The lane control mode includes a priority lane mode; The controlling the vehicle to travel in the target lane according to the lane control method includes: The vehicle is controlled to preferentially travel in the target lane.

8. The touch-controlled human-computer interaction method according to claim 5, characterized in that: The lane control mode includes a lane locking mode; The controlling the vehicle to travel in the target lane according to the lane control method includes: The vehicle is controlled to lock and travel in the target lane.

9. The touch-controlled human-computer interaction method according to claim 1, characterized in that: The surrounding environment includes a parking position, and the touch mark further includes a parking touch mark corresponding to the parking position; The real-time detection of any one of the vehicle touch indicator and the lane touch indicator being touched, and determining the control object and the control method corresponding to the touched touch indicator as a target control object and a target control method, includes: detecting in real time whether any one of the parking touch control indicator, the vehicle touch control indicator and the lane touch control indicator is touched, and if the parking touch control indicator is touched, determining the parking position as a target control object and determining parking as a target control mode; The step of controlling the vehicle to travel relative to the target control object according to the target control method includes: The vehicle is controlled to park at the parking position.

10. The touch-controlled human-computer interaction method according to any one of claims 1 to 9, characterized in that: The vehicle includes a self-vehicle and an other vehicle, and the vehicle touch identification includes a self-vehicle touch identification corresponding to the self-vehicle and an other vehicle touch identification corresponding to the other vehicle; The step of generating and displaying a touch mark on the intelligent driving perception screen of the vehicle includes: Generate and display a lane touch mark corresponding to the lane; Determine a first relative position between the ego vehicle and the ego lane where the ego vehicle is currently located, and generate and display the ego vehicle touch mark corresponding to the ego vehicle at the first relative position of the lane touch mark corresponding to the ego lane according to a preset display ratio; A second relative position between the other vehicle and the own vehicle is determined, and an other vehicle touch control mark corresponding to the other vehicle is generated and displayed at the second relative position of the own vehicle touch control mark according to the display ratio.

11. The touch-controlled human-computer interaction method according to claim 1, characterized in that: If it is detected that the lane touch indicator is touched, generating and displaying at least one lane control method includes: When it is detected that the lane touch control indicator is touched in a touch control mode for selecting lane control, at least one lane control touch indicator for indicating different lane control modes is generated and displayed.

12. The touch-controlled human-computer interaction method according to claim 10, characterized in that: After the other vehicle touch mark corresponding to the other vehicle is generated and displayed, the touch-type human-computer interaction method further includes: If it is detected that the other vehicle touch mark is touched, at least one vehicle control mode is generated and displayed.

13. The touch-controlled human-computer interaction method according to claim 12, characterized in that: If it is detected that the touch mark of the other vehicle is touched, generating and displaying at least one vehicle control method includes: When it is detected that the other-vehicle touch control indicator is touched in a touch control mode for selecting vehicle control, at least one vehicle control touch control indicator for indicating different vehicle control modes is generated and displayed.

14. The touch-controlled human-computer interaction method according to claim 10, characterized in that: After the vehicle touch mark corresponding to the vehicle is generated and displayed, the touch-controlled human-computer interaction method further includes: Determining whether the distance between one side of the vehicle and the boundary of the corresponding side of the lane is greater than a preset safety distance; If yes, a direction touch mark pointing to the corresponding side boundary of the lane is generated and displayed on the side of the vehicle touch mark; wherein the direction touch mark can be touched to indicate that the position of the vehicle is allowed to be adjusted in the direction pointed by the direction touch mark; If not, a direction indication mark pointing to the corresponding side boundary of the lane is generated and displayed on the side of the vehicle touch mark; wherein the direction indication mark is not touchable and is used to indicate that it is prohibited to adjust the position of the vehicle in the direction it points to.

15. The touch-controlled human-computer interaction method according to claim 10, characterized in that: After the vehicle touch mark corresponding to the vehicle is generated and displayed, the touch-controlled human-computer interaction method further includes: A direction touch mark pointing to the rear of the self-vehicle touch mark is generated and displayed behind the self-vehicle touch mark; wherein the direction touch mark can be touched to indicate that the position of the self-vehicle can be adjusted in the direction pointed by the direction touch mark; Determine whether the distance between the front of the vehicle and the rear of the other vehicle in front of the vehicle is greater than a preset safety distance; If yes, generating and displaying the direction touch mark pointing to the front of the own vehicle touch mark in front of the own vehicle touch mark; If not, a direction indication mark pointing in front of the vehicle touch mark is generated and displayed in front of the vehicle touch mark; wherein the direction indication mark is not touchable and is used to indicate that it is prohibited to adjust the position of the vehicle in the direction it points to.

16. The touch-controlled human-computer interaction method according to claim 10, characterized in that: The lane touch control marks corresponding to all the lanes are arranged side by side, and the lane touch control mark corresponding to the own lane is located below the own vehicle touch control mark.

17. A touch-controlled human-computer interaction device, characterized in that: include: An acquisition module, used to acquire real-time perception data of the surrounding environment of the vehicle perceived by the vehicle's perception device; wherein the surrounding environment includes the vehicle and the lane; A generation module, configured to generate and display a touch mark on the intelligent driving perception screen of the vehicle according to the real-time perception data; wherein the touch mark includes a vehicle touch mark corresponding to the vehicle and a lane touch mark corresponding to the lane, and each of the touch marks is preset with a corresponding control object and control mode; the generation module is further configured to: if it is detected that the lane touch mark is touched, generate and display at least one lane control mode; A touch control module, used for detecting in real time whether any one of the vehicle touch control mark and the lane touch control mark is touched, and determining the control object and the control mode corresponding to the touched touch control mark as a target control object and a target control mode; The control module is used to control the vehicle to travel relative to the target control object according to the target control method.

18. An electronic device, characterized in that: It comprises one or more processors, and the processor is used to implement the touch-controlled human-computer interaction method as described in any one of claims 1-16.

19. A vehicle, characterized in that: It comprises one or more processors, and the processor is used to implement the touch-controlled human-computer interaction method as described in any one of claims 1-16.

20. A computer-readable storage medium, characterized in that: A computer program is stored thereon, and when the computer program is executed by a processor, the touch-controlled human-computer interaction method according to any one of claims 1 to 16 is implemented.

Images