An interaction method, device and system, vehicle and related device

Abstract

The application provides an interaction method, device and system, a vehicle and related devices. The method comprises: receiving target action indication information from a terminal device, wherein the target action indication information is used to indicate a target vehicle action. Sending control information to a target vehicle, wherein the control information is used to control the target vehicle to perform the target vehicle action. By using the above method, the interaction cost between the terminal device and the target vehicle is reduced.

Description

Technical Field

[0001] This application relates to the field of vehicle control technology, and more particularly to an interaction method, apparatus and system, vehicle and related apparatus. Background Technology

[0002] With the development of IoT technology, accurate location identification and short-range wireless communication have become key technologies driving the intelligent upgrade of fields such as smart terminals and work automation. Against this backdrop, Ultra Wide Band (UWB) technology, with its high-precision ranging and positioning capabilities, as well as its low power consumption and high security, is becoming the core of the next generation of smart device interaction.

[0003] Existing UWB-based vehicle interaction solutions typically require both the terminal device and the vehicle to have built-in UWB modules to enable intelligent interaction between them. However, UWB modules are expensive, resulting in high interaction costs between the terminal device and the vehicle. Summary of the Invention

[0004] This application provides an interaction method, apparatus and system, vehicle and related devices, which reduces the cost of the interaction system.

[0005] In a first aspect, embodiments of this application provide an interaction method applied to a server of a vehicle interaction system, the vehicle interaction system further including a terminal device and a target vehicle bound to the terminal device. The method includes: receiving target action indication information from the terminal device, wherein the target action indication information is used to instruct the target vehicle to perform an action; and sending control information to the target vehicle, wherein the control information is used to control the target vehicle to perform the target vehicle action.

[0006] In this embodiment, the interaction system allows the server to determine control information based on target action indication information generated from the first terminal device and send it to the target vehicle to control the target vehicle to perform target vehicle actions. This interaction system enables intelligent interaction between the first terminal device and the target vehicle through the server, without requiring UWB hardware support, thus reducing the interaction cost between the terminal device and the target vehicle.

[0007] In conjunction with the first aspect, in one feasible implementation, the terminal device is in a locked screen state, and the target action indication information is generated by the terminal device when it detects the target screen operation information corresponding to the target screen area through the target screen area.

[0008] In the above implementation, when the first terminal device is in a locked state, the user can generate action instruction information by operating the screen of the first terminal device to control the target vehicle to perform corresponding vehicle actions. This eliminates the need for the user to unlock the first terminal device 12 to control the vehicle through the corresponding functions, thereby improving the practicality and convenience of the interactive system and enhancing the user experience.

[0009] In conjunction with the first aspect, in one feasible implementation, the terminal device includes multiple screen areas, the multiple screen areas including the target screen area, each of the multiple screen areas corresponds to different action indication information, the different action indication information is used to indicate different vehicle actions, and the terminal device generates action indication information corresponding to any screen area when it detects screen operation information corresponding to any screen area through any screen area of ​​the multiple screen areas.

[0010] In conjunction with the first aspect, in one feasible implementation, the target action indication information is generated by the terminal device based on the user's gesture information and a gesture control set, wherein the gesture control set includes at least one gesture information and vehicle actions corresponding to each gesture information in the at least one gesture information.

[0011] In conjunction with the first aspect, in one feasible implementation, the target action instruction information is generated by the terminal device based on the voice information input by the user.

[0012] In conjunction with the first aspect, in one feasible implementation, the gesture information is determined by the terminal device based on the terminal device's position information and / or rotation angle.

[0013] In conjunction with the first aspect, in one feasible implementation, sending control information to the target vehicle includes: determining a first distance between the terminal device and the target vehicle. If the first distance is determined to be within a preset distance range, then control information is sent to the target vehicle.

[0014] In the above implementation, the server can determine the first distance between the first terminal device and the target vehicle. Only when the first distance is within the preset distance range can the server send control information to the target vehicle. This can prevent the server from mistakenly sending control information to the target vehicle, thereby improving the security and reliability of the interactive system.

[0015] In conjunction with the first aspect, in one feasible implementation, sending control information to the target vehicle includes: determining a first distance between the terminal device and the target vehicle; receiving a second distance from the terminal device, wherein the second distance is determined by the terminal device and is the distance between the terminal device and the target vehicle; and if both the first distance and the second distance are determined to be within a preset distance range, then sending control information to the target vehicle.

[0016] In conjunction with the first aspect, in one feasible implementation, the vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0017] Secondly, embodiments of this application provide an interaction method applied to a terminal device of a vehicle interaction system, wherein the vehicle interaction system further includes a server and a target vehicle bound to the terminal device. The method includes: determining target action indication information, wherein the target action indication information is used to indicate a target vehicle action; and sending the target action indication information to the server, wherein the target action indication information is used by the server to determine control information, the control information being used to control the target vehicle to perform the target vehicle action.

[0018] In conjunction with the second aspect, in one feasible implementation, the terminal device is in a locked screen state, and determining the target action indication information includes: determining the target action indication information based on the target screen operation information detected in the target screen area.

[0019] In conjunction with the second aspect, in one feasible implementation, the terminal device includes multiple screen areas, including the target screen area. Each screen area in the multiple screen areas corresponds to different action indication information, which is used to indicate different vehicle actions. The terminal device generates action indication information corresponding to any screen area when it detects screen operation information corresponding to any screen area through any screen area in the multiple screen areas.

[0020] In conjunction with the second aspect, in one feasible implementation, determining the target action instruction information includes: determining the target action instruction information based on the user's gesture information and a gesture control set, wherein the gesture control set includes at least one gesture information and vehicle actions corresponding to each gesture information in the at least one gesture information.

[0021] In conjunction with the second aspect, in one feasible implementation, sending the target action instruction information to the server includes: generating first reminder information, wherein the first reminder information is used to determine whether the user agrees to the target vehicle performing the target vehicle action. If it is determined from the first reminder information that the user agrees to the target vehicle performing the target vehicle action, then the target action instruction information is sent to the server.

[0022] In conjunction with the second aspect, in one feasible implementation, the vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0023] Thirdly, embodiments of this application provide an interaction method applied to a target vehicle in a vehicle interaction system. The vehicle interaction system further includes a terminal device bound to the target vehicle and a server. The method includes: receiving control information from the server, wherein the control information is determined by target action indication information from the terminal device, and the target action indication information is used to instruct the target vehicle to perform an action; and executing the target vehicle action according to the control information.

[0024] In conjunction with the third aspect, in one feasible implementation, the target vehicle action is to unlock the vehicle door. Executing the target vehicle action according to the control information includes: if it is determined that an obstacle exists in the vehicle's blind spot, then sending a second reminder message to the terminal device. If, based on the terminal device's response to the second reminder message, it is determined that the user agrees to the vehicle performing the target vehicle action, then the target vehicle action is executed according to the control information.

[0025] In conjunction with the third aspect, in one feasible implementation, the vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0026] Fourthly, this application provides an interactive device, which can be the server mentioned in the first aspect. The interactive device includes a processing unit and a transceiver unit. The transceiver unit is used to receive target action indication information from the terminal device, wherein the target action indication information is used to instruct a target vehicle to perform an action. The processing unit is used to generate control information, wherein the control information is used to control the target vehicle to perform the target vehicle action. The transceiver unit is used to send the control information to the target vehicle.

[0027] In conjunction with the fourth aspect, in one feasible implementation, the terminal device is in a locked screen state, and the target action indication information is generated by the terminal device when it detects the target screen operation information corresponding to the target screen area through the target screen area.

[0028] In conjunction with the fourth aspect, in one feasible implementation, the terminal device includes multiple screen areas, including the target screen area. Each screen area in the multiple screen areas corresponds to different action indication information, which is used to indicate different vehicle actions. The terminal device generates action indication information corresponding to any screen area when it detects screen operation information corresponding to any screen area through any screen area in the multiple screen areas.

[0029] In conjunction with the fourth aspect, in one feasible implementation, the target action indication information is generated by the terminal device based on the user's gesture information and a gesture control set, wherein the gesture control set includes at least one gesture information and the vehicle action corresponding to each gesture information in the at least one gesture information.

[0030] In conjunction with the fourth aspect, in one feasible implementation, the target action instruction information is generated by the terminal device based on the voice information input by the user.

[0031] In conjunction with the fourth aspect, in one feasible implementation, the gesture information is determined by the terminal device based on the terminal device's position information and / or rotation angle.

[0032] In conjunction with the fourth aspect, in one feasible implementation, the processing unit is further configured to determine a first distance between the terminal device and the target vehicle. The processing unit is also configured to send control information to the target vehicle if the first distance is determined to be within a preset distance range.

[0033] In conjunction with the fourth aspect, in one feasible implementation, the processing unit is further configured to determine a first distance between the terminal device and the target vehicle. The transceiver unit is further configured to receive a second distance from the terminal device, wherein the second distance is determined by the terminal device and is the distance between the terminal device and the target vehicle. The processing unit is further configured to send control information to the target vehicle if it is determined that both the first distance and the second distance are within the preset distance range.

[0034] In conjunction with the fourth aspect, in one feasible implementation, the vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0035] Fifthly, this application provides an interactive device, which can be the terminal device mentioned in the second aspect above. The interactive device includes a processing unit and a transceiver unit. The processing unit is configured to determine target action indication information, wherein the target action indication information is used to instruct a target vehicle to perform an action. The transceiver unit is configured to send the target action indication information to the server, wherein the target action indication information is used by the server to determine control information, and the control information is used to control the target vehicle to perform the target vehicle action.

[0036] In conjunction with the fifth aspect, in one feasible implementation, the processing unit is further configured to determine target action instruction information based on target screen operation information detected in the target screen area.

[0037] In conjunction with the fifth aspect, in one feasible implementation, the terminal device includes multiple screen areas, the multiple screen areas including the target screen area, each of the multiple screen areas corresponds to different action indication information, the different action indication information is used to indicate different vehicle actions, and the terminal device generates action indication information corresponding to any screen area when it detects screen operation information corresponding to any screen area through any screen area of ​​the multiple screen areas.

[0038] In conjunction with the fifth aspect, in one feasible implementation, the processing unit is further configured to determine target action instruction information based on the user's gesture information and a gesture control set, wherein the gesture control set includes at least one gesture information and vehicle actions corresponding to each gesture information in the at least one gesture information.

[0039] In conjunction with the fifth aspect, in one feasible implementation, the processing unit is further configured to generate first reminder information, wherein the first reminder information is used to determine whether the user agrees to the target vehicle performing the target vehicle action. The processing unit is further configured to, if it is determined from the first reminder information that the user agrees to the target vehicle performing the target vehicle action, send target action instruction information to the server.

[0040] In conjunction with the fifth aspect, in one feasible implementation, the vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0041] Sixthly, this application provides an interactive device, which can be the target vehicle mentioned in the third aspect above. The interactive device includes a processing unit and a transceiver unit. The transceiver unit is used to receive control information from the server, wherein the control information is determined by target action indication information of the terminal device, and the target action indication information is used to instruct the target vehicle to perform an action. The processing unit is used to execute the target vehicle action according to the control information.

[0042] In conjunction with the sixth aspect, in one feasible implementation, the processing unit is further configured to send a second alert message to the terminal device if it is determined that an obstacle exists in the blind spot of the vehicle. The processing unit is also configured to execute the target vehicle action according to the control information if it is determined from the terminal device's response to the second alert message that the user agrees to the vehicle performing the target vehicle action.

[0043] In conjunction with the sixth aspect, in one feasible implementation, the vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0044] In a seventh aspect, embodiments of this application provide a server, which includes a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it can implement the interaction method provided in the first aspect, and also achieve the beneficial effects of the interaction method provided in the first aspect.

[0045] Eighthly, embodiments of this application provide a terminal device, which includes a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it can implement the interaction method provided in the second aspect, and also achieve the beneficial effects of the interaction method provided in the second aspect.

[0046] Ninthly, embodiments of this application provide a vehicle controller, the terminal device including a memory and a processor. The memory stores a computer program, and when the processor executes the computer program, it can implement the interaction method provided in the third aspect, and also achieve the beneficial effects of the interaction method provided in the third aspect.

[0047] In a tenth aspect, this application provides an interactive system comprising a server and a vehicle controller. The server is configured to execute the interactive methods provided by the first aspect or any possible implementation thereof, and the controller is configured to execute the interactive methods provided by the third aspect or any possible implementation thereof.

[0048] In conjunction with the tenth aspect, in one possible implementation, the interactive system further includes a terminal device that can be used to execute the interactive method provided by the second aspect or any possible implementation thereof.

[0049] In the eleventh aspect, this application provides a vehicle that includes the controller provided in the ninth aspect above.

[0050] In a twelfth aspect, embodiments of this application provide a computer-readable storage medium for storing a computer program that, when run on a computer, causes the computer to execute an interaction method provided by any possible implementation of the first aspect, or an interaction method provided by any possible implementation of the second aspect, or an interaction method provided by any possible implementation of the third aspect.

[0051] In a thirteenth aspect, embodiments of this application provide an electronic device that may include a processor and a memory, which are interconnected. The memory stores a computer program, and the processor is configured to execute the computer program to implement the interaction method provided in the first aspect, or to implement the interaction method provided in any possible implementation of the second aspect, or to implement the interaction method provided in any possible implementation of the third aspect.

[0052] By implementing the embodiments of the present invention, the interactive system allows the server to determine control information based on target action indication information generated from the first terminal device and send it to the target vehicle to control the target vehicle to perform target vehicle actions. This interactive system enables intelligent interaction between the first terminal device and the target vehicle through the server, without requiring UWB hardware support, thus reducing the interaction cost between the terminal device and the vehicle. Attached Figure Description

[0053] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0054] Figure 1 This is a schematic diagram of the architecture of an interactive system provided in an embodiment of this application;

[0055] Figure 2 This is a schematic diagram of the architecture of another interactive system provided in the embodiments of this application;

[0056] Figure 3 This is a flowchart illustrating an interaction method provided in an embodiment of this application;

[0057] Figure 4 This is a schematic diagram of a screen area in a locked state provided in an embodiment of this application;

[0058] Figure 5 This is a schematic diagram of an interface for a reminder message provided in an embodiment of this application;

[0059] Figure 6 This is an interactive schematic diagram of an interactive system provided in an embodiment of this application;

[0060] Figure 7 This is an interactive schematic diagram of another interactive system provided in the embodiments of this application;

[0061] Figure 8 This is a schematic diagram of the structure of an interactive device provided in an embodiment of this application;

[0062] Figure 9 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0063] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings.

[0064] Existing UWB-based vehicle interaction solutions typically require both the terminal device and the vehicle to have built-in UWB modules to enable intelligent interaction between them. However, UWB modules are generally expensive, leading to high interaction costs between the terminal device and the vehicle. Therefore, the technical problem this application aims to solve is: how to reduce the interaction costs between the terminal device and the vehicle.

[0065] Please see Figure 1 , Figure 1 This is a schematic diagram of the architecture of an interactive system provided in an embodiment of this application. For example... Figure 1As shown, the interactive system 10 may include a server 11, a terminal device used by the user (hereinafter referred to as the first terminal device) 12 for easy distinction, and a target vehicle 13 bound to the first terminal device 12. The server 11 may establish communication connections with the first terminal device 12 and the target vehicle 13 respectively.

[0066] In practice, users can perform control actions on the first terminal device 12, such as shaking, clicking, or voice input. The first terminal device 12 can then generate target action instruction information based on the user's control actions and send it to the server 11. Here, the target action instruction information can be used to instruct vehicle actions. Furthermore, after receiving the target action instruction information, the server 11 can generate control information based on the action instruction information and send it to the target vehicle 13 bound to the first terminal device 12 to control the target vehicle 13 to perform certain specific vehicle actions, such as unlocking / locking the doors, unfolding / closing the exterior rearview mirrors, and opening / closing the windows.

[0067] The vehicle actions may include, at a minimum, unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening and closing the power tailgate, opening and closing the power tailgate, opening and closing the side doors, activating the automatic parking function, or activating the autonomous vehicle summoning function. This application is not limited to these.

[0068] Optionally, server 11 can obtain vehicle identification information of all vehicles in interactive system 10, and receive terminal device identification information and target vehicle identification information sent from first terminal device 12. Further, server 11 can identify the vehicle in interactive system 10 whose vehicle identification information matches the target vehicle identification information as target vehicle 13, and can establish a binding relationship between target vehicle 13 and first terminal device 12.

[0069] It should be noted that the first terminal device 12 can establish a communication connection with the server 11 through its installed vehicle application. After generating target action instruction information, the first terminal device 12 can send it to the server 11 through the vehicle application in the first terminal device 12, and the server 11 can further generate control information and send it to the target vehicle 13. Optionally, the server of the vehicle application can be the server 11 provided in this application.

[0070] The vehicle application can be an application that has the function of controlling or managing vehicles. This application embodiment is not limited in this respect.

[0071] Optionally, the target action indication information and control information may contain the same content; that is, the target action indication information and control information may be the same information. When the target action indication information and control information are the same information, the server 11 is equivalent to forwarding the information from the first terminal device 12 to the target vehicle 13.

[0072] It should be noted that the number of first terminal devices 12 in the interactive system 10 involved in this application can be one or more, and this application does not impose any specific restrictions on this.

[0073] When there are multiple first terminal devices 12, these multiple terminal devices can establish communication connections, and one of the terminal devices can establish a communication connection with the server 11. The terminal device that establishes a communication connection with the server 11 can receive action instruction information from other terminal devices, and can send the action instruction information to the server 11, which then generates control information and sends it to the target vehicle 13 to control the target vehicle 13 to perform vehicle actions.

[0074] For ease of understanding, the following explanation uses the example of the interactive system 10 including two terminal devices to illustrate the structure and specific implementation of the interactive system 10.

[0075] Optional, please see Figure 2 , Figure 2 This is a schematic diagram of the architecture of another interactive system provided in an embodiment of this application. For example... Figure 2 As shown, the interactive system 10 may further include a terminal device (hereinafter referred to as the second terminal device) 14 for easy distinction. The second terminal device 14 is communicatively connected to the first terminal device 12.

[0076] In practice, users can control the second terminal device 14 by shaking, clicking, or using voice input. The second terminal device 14 can then generate action instruction information based on the user's control actions and send it to the first terminal device 12. Here, the action instruction information can be used to instruct vehicle actions. After receiving the action instruction information from the second terminal device 14, the first terminal device 12 can generate target action instruction information and send it to the server 11. Furthermore, after receiving the target action instruction information, the server 11 can generate control information based on the action instruction information and send it to the target vehicle 13 bound to the first terminal device 12 to control the target vehicle 13 to perform certain specific vehicle actions, such as unlocking / locking doors, unfolding / closing exterior rearview mirrors, and opening / closing windows.

[0077] It should be noted that the action instruction information of the second terminal device 14 and the target action instruction information of the first terminal device 12 contain the same content; that is, these two pieces of information can be the same. In other words, the first terminal device 12 is equivalent to forwarding the action instruction information generated by the second terminal device 14 to the server 11.

[0078] For example, it is assumed here that the first terminal device 12 is a smartphone and the second terminal device 14 is a smart bracelet. The smartphone and smart bracelet establish a communication connection, and the smartphone also establishes a communication connection with the server 11. In actual implementation, the smart bracelet can determine the corresponding action instruction information based on the user's control actions and send this action instruction information to the smartphone. After receiving the action instruction information, the smartphone can generate control information and send it to the target vehicle 13 bound to the smartphone, thereby controlling the target vehicle 13 to perform the vehicle actions indicated by the action instruction information.

[0079] In this embodiment, server 11 can be a single server, a server cluster consisting of several servers, or a cloud computing service center. Terminal devices can be intelligent terminals capable of human-computer interaction, such as smartphones, tablets, laptops, wearable devices, head-mounted devices, and in-vehicle terminals. This application does not impose specific limitations on the implementation form of server 11 and terminal devices.

[0080] The following describes an interactive method provided by an embodiment of this application.

[0081] Please see Figure 3 , Figure 3 This is a flowchart illustrating an interaction method provided in an embodiment of this application. This method can be applied to the preceding text. Figure 1 or Figure 2 The interactive system 10 shown is as follows. Figure 3 As shown, the method may specifically include the following steps:

[0082] S301, the first terminal device 12 determines the target action instruction information.

[0083] In some feasible implementations, the first terminal device 12 may first determine the target action indication information. Here, the target action indication information can be used to instruct the target vehicle to perform actions.

[0084] In the first optional implementation, when the first terminal device 12 is in a locked screen state, the aforementioned target action indication information can be generated by the first terminal device 12 when it detects the target screen operation information corresponding to the target screen area through the target screen area.

[0085] It should be noted that screen operation information may include user click operations or operations to draw preset shapes in the first screen area, etc., and this application does not limit this.

[0086] In other words, when the first terminal device 12 is in a locked state, the user can perform screen operation information such as clicking or drawing preset graphics in the target screen area of ​​the first terminal device 12 to trigger the first terminal device 12 to generate target action instruction information based on the screen operation information.

[0087] It should be noted that the preset graphic can be customized by the user through the first terminal device 12, such as a circle, triangle, X, checkmark, etc. This application does not limit this.

[0088] Optionally, the first terminal device 12 may include multiple screen areas, including the aforementioned target screen area. Each of these multiple screen areas may correspond to different action instruction information, and different instruction information can be used to instruct different vehicle actions. The first terminal device 12 may generate action instruction information corresponding to any screen area if it detects screen operation information corresponding to any screen area through any of these multiple screen areas.

[0089] In a possible design, the vehicle action corresponding to each of the multiple screen areas of the first terminal device 12 can be displayed. For an example, please refer to... Figure 4 , Figure 4 This is a schematic diagram of a screen area in a locked state provided in an embodiment of this application. For example... Figure 4 As shown, the first terminal device 12 includes eight screen areas, and the vehicle actions corresponding to these eight screen areas are, in sequence, activating the autonomous vehicle summoning function, activating the automatic parking function, unlocking the car door, locking the car door, opening the electric tailgate, closing the electric tailgate, opening the car window, and closing the car window.

[0090] It should be noted that the screen operation information corresponding to each of the aforementioned multiple screen areas may be the same or different. This application does not limit the comparison. For example, assuming the first terminal device 12 has screen area A and screen area B, the user's screen operation in both screen area A and screen area B can be a click. As another example, assuming the first terminal device 12 has screen area A and screen area B, the user's screen operation in screen area A can be drawing a circle, and the user's screen operation in screen area B can be drawing a triangle.

[0091] In other words, when the first terminal device 12 is in a locked state, the first terminal device 12 may include multiple screen areas, and the vehicle actions corresponding to the multiple screen areas are different. The user can select the screen area corresponding to the corresponding vehicle action according to the needs and perform screen operations, which can trigger the first terminal device 12 to generate second action instruction information based on the screen operation information corresponding to the screen area.

[0092] It should be noted that the preceding description outlines the process by which the first terminal device 12 generates corresponding action instruction information within a screen area based on the screen operation information corresponding to that screen area. In possible designs, the first terminal device 12 can also generate different action instruction information within a screen area based on different screen operation information, and these different action instruction information can be used to instruct different vehicle actions. It should be understood that there is a one-to-one correspondence between screen operation information and action instruction information, that is, a one-to-one correspondence between screen operation information and vehicle actions.

[0093] In other words, when the first terminal device 12 is in a locked state, the user can trigger the first terminal device 12 to generate corresponding action instruction information based on the screen operation information through different screen operation information within a screen area of ​​the first terminal device 12. This can control the target vehicle 13 to perform different vehicle actions, thereby improving the utilization rate of the screen area of ​​the first terminal device 12.

[0094] For example, when the screen operation within a certain screen area is drawing a circle, the corresponding action indicator information indicates that the vehicle action is to lock the vehicle. When the screen operation within the same screen area is drawing a triangle, the corresponding action indicator information indicates that the vehicle action is to unlock the vehicle.

[0095] For example, if the screen operation within a certain screen area is to tap the screen once, the corresponding action indicator will indicate that the vehicle is locked. If the screen operation within the same screen area is to tap the screen twice, the corresponding action indicator will indicate that the vehicle is unlocked.

[0096] It should be noted that the screen operation information or action instruction information corresponding to any screen area can be set by the user through the vehicle application in the first terminal device 12 as needed. This application embodiment does not limit this.

[0097] In the above implementation, when the first terminal device 12 is in a locked state, the user can generate action instruction information by operating the screen of the first terminal device 12 to control the target vehicle 13 to perform corresponding vehicle actions. This eliminates the need for the user to unlock the first terminal device 12 to control the vehicle through the corresponding functions, thereby improving the practicality and convenience of the interactive system 10 and enhancing the user experience.

[0098] In a second alternative implementation, the target action instruction information can be generated by the first terminal device 12 based on the user's gesture information and a gesture control set. Here, the gesture control set may include at least one gesture information and the vehicle action corresponding to each gesture information.

[0099] For example, suppose the gesture control set includes gesture information such as clockwise and counterclockwise shaking and left and right lateral shaking, and the vehicle action corresponding to clockwise and counterclockwise shaking is unlocking the car door, and the vehicle control action corresponding to left and right lateral shaking is opening the power tailgate. Assuming the user's gesture information is clockwise and counterclockwise shaking, the first terminal device 12 can generate target action indication information for indicating unlocking the car door based on the gesture information and the gesture control set.

[0100] It should be noted that the gesture information can be actions performed by the user to control the first terminal device 12, such as shaking clockwise or counterclockwise, or shaking horizontally left or right. The gesture information can also be the user's hand movements, which can be recognized and determined by the first terminal device 12. This application embodiment does not limit this aspect.

[0101] Optionally, when the gesture information is for the user to control the action of the first terminal device 12, the gesture information can be determined by the first terminal device 12 based on its position information and / or rotation angle.

[0102] In a third optional implementation, the aforementioned target action indication information can be generated by the first terminal device 12 based on the user's input voice information. Specifically, after acquiring the user's input voice information, the first terminal device 12 can perform voice recognition on the voice information to determine the vehicle action contained within it. Further, the first terminal device 12 can generate the target action indication information based on the determined vehicle action.

[0103] For example, suppose the user inputs the voice message "unlock the car door". The terminal device performs voice recognition on the user's voice message "unlock the car door" and can determine that the vehicle action it contains is unlocking the car door. Furthermore, the first terminal device 12 can determine the corresponding target action instruction information based on the vehicle action of unlocking the car door.

[0104] In a fourth optional implementation, if the interactive system 10 includes a second terminal device 14, the second terminal device 14 can first generate action indication information and send it to the first terminal device. Furthermore, the first terminal device 12 can determine the target action indication information based on this action indication information.

[0105] It should be noted that the process by which the second terminal device 14 determines the action instruction information is similar to the process by which the first terminal device 12 determines the action instruction information as described above. To avoid redundancy, it will not be repeated here.

[0106] S302, the first terminal device 12 sends target action indication information to the server 11. Correspondingly, the server 11 receives the target action indication information.

[0107] In some feasible implementations, after determining the target action indication information, the first terminal device 12 can send the target action indication information to the server 11.

[0108] Optionally, before sending the target action instruction information to the server 11, the first terminal device 12 may first generate a first reminder message. Here, the first reminder message can be used to determine whether the user agrees to the target vehicle 13 performing the target vehicle action indicated by the target action instruction information. Further, if the first terminal device 12 determines, based on the first reminder message, that the user agrees to the target vehicle 13 performing the target vehicle action, then it may send the target action instruction information to the server 11. If the first terminal device 12 determines, based on the first reminder message, that the user does not agree to the target vehicle 13 performing the target vehicle action, then it will not send the target action instruction information to the server 11.

[0109] For example, please see Figure 5 , Figure 5 This is a schematic diagram of an interface for a notification message provided in this application. For example... Figure 5 As shown, before the first terminal device 12 sends the target action instruction information to the server 11, the first terminal device 12 can generate and output a reminder message "Do you agree to perform this operation?". If the user clicks "Agree" through the first terminal device 12, it can be determined that the user agrees to the target vehicle 13 performing the target vehicle action, and then the target action instruction information can be sent to the server 11. If the user clicks "Disagree" through the first terminal device 12, it can be determined that the user does not agree to the target vehicle 13 performing the target vehicle action, and then the target action instruction information will not be sent to the server 11.

[0110] Optionally, if the first terminal device 12 determines, based on the first reminder information, that the number of times the user disagrees with the target vehicle 13 performing the target vehicle action is greater than a preset number within the first preset time period, then it will no longer generate the first reminder information within the second preset time period and will not send the target action instruction information to the server 11.

[0111] In the above implementation, before sending the target action instruction information to the server 11, the first terminal device 12 can determine whether the user agrees to perform the operation by generating a first reminder message. This can prevent the first terminal device 12 from generating the target action instruction information due to the user's mistake, thereby preventing the target vehicle 13 from performing the corresponding vehicle action and improving the security and reliability of the interactive system 10.

[0112] S303, server 11 sends control information to target vehicle 13. Accordingly, target vehicle 13 receives the control information.

[0113] In some feasible implementations, after receiving target action instruction information from the first terminal device 12, the server 11 can generate control information based on the target action instruction information and send the control information to the target vehicle 13 bound to the first terminal device 12. Here, the control information can be used to control the target vehicle 13 to perform the aforementioned target vehicle action.

[0114] Optionally, the server 11 may generate control information based on the target action indication information and send it to the target vehicle 13 only if the number of times it receives the target action indication information is greater than a preset number.

[0115] In one optional implementation, before sending control information to the target vehicle 13, the server 11 can first determine the target vehicle 13 bound to the first terminal device 12. Specifically, the server 11 can receive terminal device identification information and target vehicle identification information sent by the first terminal device 12. The server 11 can also obtain vehicle identification information of all vehicles in the interactive system 10. Furthermore, the server 11 can determine the vehicle that matches the target vehicle identification information as the target vehicle 13.

[0116] In the above implementation, the interactive system 10 does not require the first terminal device 12 to establish a connection with the target vehicle 13 by performing identity authentication and other operations. Instead, the server 11 determines the binding relationship between the first terminal device 12 and the target vehicle 13, which can improve the response speed of the interactive system 10.

[0117] In one alternative implementation, before sending control information to the target vehicle 13, the server 11 may first determine a first distance between the first terminal device 12 and the target vehicle 13. Specifically, the server 11 may determine the distance between itself and the target vehicle 13 through a vehicle application, or the server 11 may call an application with positioning functionality on the first terminal device 12 to determine the distance between itself and the target vehicle 13.

[0118] Furthermore, if server 11 determines that the first distance is within the preset distance range, it can send control information to target vehicle 13. If server 11 determines that the first distance is not within the preset distance range, it will not send control information to target vehicle 13.

[0119] For example, assuming the preset distance range is [0m, 10m], and assuming the first distance between the first terminal device 12 and the target vehicle 13 is determined to be 6m. The server 11 can first determine that the first distance between the first terminal device 12 and the target vehicle 13 is 6m, which is within the preset distance range [0m, 10m], and then the server 11 can send control information to the target vehicle 13.

[0120] In another alternative implementation, server 11 may first determine a first distance between the first terminal device 12 and the target vehicle 13. Specifically, server 11 may determine the first distance through a vehicle application. The first terminal device 12 may also determine a second distance between itself and the target vehicle 13 and send the second distance to server 11. Further, if server 11 determines that both the first and second distances are within a preset distance range, it may send control information to the target vehicle 13. If server 11 determines that either the first or second distance is not within the preset distance range, it will not send control information to the target vehicle 13.

[0121] Optionally, after determining the first distance, server 11 may first determine whether the first distance is within a preset distance range. If server 11 determines that the first distance is within the preset distance range, it may send an instruction to the first terminal device 12, causing the first terminal device 12 to determine a second distance between itself and the target vehicle 13. After receiving the instruction, the first terminal device 12 may determine the second distance and send it to server 11. Further, if server 11 determines that both the first and second distances are within the preset distance range, it may send control information to the target vehicle 13. If server 11 determines that the second distance is not within the preset distance range, it will not send control information to the target vehicle 13.

[0122] It should be noted that the preset distance range can be the factory default of the interactive system 10, or it can be temporarily configured by the administrator.

[0123] In the above implementation, the server 11 can determine the first distance between the first terminal device 12 and the target vehicle 13. Only when the first distance is within the preset distance range can the server 11 send control information to the target vehicle 13. This can prevent the server 11 from mistakenly sending control information to the target vehicle 13, thereby improving the security and reliability of the interactive system 10.

[0124] S304, Target vehicle 13 executes target vehicle actions according to control information.

[0125] In some feasible implementations, after receiving control information from server 11, target vehicle 13 can further perform corresponding target vehicle actions based on the control information.

[0126] Optionally, when the target vehicle's action is to unlock its doors (e.g., open a side door), the target vehicle 13 can first determine whether there are obstacles in its blind spot. Here, obstacles can be pedestrians, vehicles, or other objects. Specifically, the target vehicle 13 can acquire environmental information about the vehicle through a camera installed on the vehicle, and further determine whether there are pedestrians or other vehicles or other obstacles in the target vehicle 13's blind spot based on the environmental information. Furthermore, if the target vehicle 13 determines that there are no obstacles in its blind spot, it can control the target vehicle 13 to open the side door. If the target vehicle 13 determines that there are obstacles in its blind spot, it can continuously acquire environmental information about the target vehicle 13 until it is determined based on the environmental information that there are no obstacles in its vicinity, before controlling the target vehicle 13 to open the side door. This can improve the security of the interaction system 10.

[0127] Optionally, if the target vehicle 13 determines that there is an obstacle in its blind spot, it can output a second reminder message to the first terminal device 12 to remind the user of the obstacle and determine whether the user agrees to perform the target vehicle action. Further, the user can determine whether to perform the target vehicle action through the first terminal device 12. If the target vehicle 13 determines that the user agrees to perform the target vehicle action based on the first terminal device 12's response to the second reminder message, it can perform the target vehicle action according to the control information, i.e., open the side door. If the target vehicle 13 determines that the user does not agree to perform the target vehicle action based on the first terminal device 12's response to the second reminder message, it will not perform the target vehicle action, i.e., it will not open the side door.

[0128] In this embodiment, the interaction system 10 can be controlled by the server 11 to determine control information based on the target action instruction information generated from the first terminal device 12, and then send it to the target vehicle 13 to control the target vehicle 13 to perform target vehicle actions. This interaction system 10 can realize intelligent interaction between the first terminal device 12 and the target vehicle 13 through the server 11, without requiring UWB hardware support, thus reducing the interaction cost between the first terminal device 12 and the target vehicle 13.

[0129] The preceding text provided several possible implementation methods; the following section will combine them with... Figure 6 and Figure 7 To each Figure 1 and Figure 2The possible implementations of the interactive system 10 shown are illustrated by way of example. It should be understood that logic and terminology not explained below can be found in the description of the preceding embodiments, and will not be repeated here.

[0130] In one possible implementation, the first terminal device 12 can generate target action instruction information based on the user's control actions and send it to the vehicle application in the first terminal device 12. Here, the server of the vehicle application is equivalent to the server 11 described above. Then, the vehicle application can send first information to the first application with positioning function in the first terminal device 12 to determine the target distance between the first terminal device 12 and the target vehicle 13. After the first application determines the target distance, it can send second information to the vehicle application, where the second information can be used to indicate the target distance between the first terminal device 12 and the target vehicle 13. Further, if the vehicle application determines that the target distance is within a preset distance range, it can send control information to the target vehicle 13 to control the target vehicle 13 to perform the target vehicle action.

[0131] Please see Figure 6 , Figure 6 This is an interactive schematic diagram of an interactive system provided in this application, which can be applied to the preceding text. Figure 1 The interactive system 10 shown is as follows. Figure 6 As shown, the interaction method may include one or more steps from S601 to S604, as detailed below:

[0132] S601, the first terminal device 12 sends target action instruction information to the vehicle application.

[0133] S602, the vehicle application sends the first information to the first application.

[0134] The first information can be used to instruct the first application to determine the first distance between the first terminal device 12 and the target vehicle 13.

[0135] S603, the first application sends the second information to the vehicle application.

[0136] The second information can be used to indicate the first distance between the first terminal device 12 and the target vehicle 13.

[0137] S604, the vehicle application sends control information to the target vehicle 13.

[0138] In one possible implementation, the second terminal device 14 can generate target action instruction information based on the user's control actions and send it to a second application within the second terminal device 14. The second application then forwards the target action instruction information to the first terminal device 12. Further, the first terminal device 12 can send the target action instruction information to a vehicle application. Here, the server of the vehicle application is equivalent to the server 11 described above. Then, the vehicle application can send first information to the first application with positioning capabilities in the first terminal device 12 to determine a first distance between the first terminal device 12 and the target vehicle 13. After the first application determines the first distance, it can send second information to the vehicle application, where the second information can be used to indicate the first distance between the first terminal device 12 and the target vehicle 13. Further, if the vehicle application determines that the first distance is within a preset distance range, it can send control information to the target vehicle 13 to control the target vehicle 13 to perform target vehicle actions.

[0139] Please see Figure 7 , Figure 7 This is an interactive schematic diagram of another interactive system provided in this application, which can be applied to the preceding text. Figure 2 The interactive system 10 shown is as follows. Figure 7 As shown, the interaction method may include one or more steps from S601 to S605, as detailed below:

[0140] S701, the second terminal device 14 sends target action instruction information to the second application.

[0141] S702, the second application sends target action instruction information to the vehicle application.

[0142] S703, the vehicle application sends the first information to the first application.

[0143] The first information can be used to instruct the first application to determine the first distance between the first terminal device 12 and the target vehicle 13.

[0144] S704, the first application sends the second information to the vehicle application.

[0145] The second information can be used to indicate the first distance between the first terminal device 12 and the target vehicle 13.

[0146] S705, the vehicle application sends control information to the target vehicle 13.

[0147] The above, combined with Figures 3 to 7 The interaction method provided in the embodiments of this application is described in detail below. Figure 8 and Figure 9This application provides a detailed description of the interactive device provided in its embodiments. It should be understood that the description of the embodiments of this interactive device corresponds to the description of the embodiments of the interactive method; therefore, any parts not described in detail can be referred to the foregoing method embodiments.

[0148] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of an interactive device provided in an embodiment of this application. For example... Figure 8 As shown, the interactive device 80 may include a transceiver unit 81 and a processing unit 82.

[0149] In some feasible implementations, the interactive device 80 may correspond to the server 11 mentioned above.

[0150] In a specific implementation, the transceiver unit 81 is used to receive target action indication information from the terminal device, wherein the target action indication information is used to instruct the target vehicle to perform actions. The processing unit 82 is used to generate control information, wherein the control information is used to control the target vehicle to perform target vehicle actions. The transceiver unit 81 is used to send the control information to the target vehicle.

[0151] In one possible implementation, the terminal device is in a locked state, and the target action indication information is generated by the terminal device when it detects the target screen operation information corresponding to the target screen area through the target screen area.

[0152] In one possible implementation, the terminal device includes multiple screen areas, including a target screen area. Each screen area in the multiple screen areas corresponds to different action indication information. The different action indication information is used to indicate different vehicle actions. The terminal device generates action indication information corresponding to any screen area when it detects screen operation information corresponding to any screen area through any screen area in the multiple screen areas.

[0153] In one possible implementation, the target action instruction information is generated by the terminal device based on the user's gesture information and a gesture control set, which includes at least one gesture information and the vehicle action corresponding to each gesture information in the at least one gesture information.

[0154] In one possible implementation, the target action instruction information is generated by the terminal device based on the user's voice input.

[0155] In one possible implementation, the gesture information is determined by the terminal device based on the terminal device's position information and / or rotation angle.

[0156] In one possible implementation, the processing unit 82 is further configured to determine a first distance between the terminal device and the target vehicle. The processing unit 82 is also configured to send control information to the target vehicle if the first distance is determined to be within a preset distance range.

[0157] In one possible implementation, the processing unit 82 is further configured to determine a first distance between the terminal device and the target vehicle. The transceiver unit 81 is further configured to receive a second distance from the terminal device, wherein the second distance is determined by the terminal device and is the distance between the terminal device and the target vehicle. The processing unit 82 is further configured to send control information to the target vehicle if it is determined that both the first distance and the second distance are within a preset distance range.

[0158] In one possible implementation, vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0159] In some feasible implementations, the interactive device 80 may correspond to the first terminal device 12 mentioned above, or a component (such as a circuit, chip, or chip system) configured in the first terminal device 12.

[0160] In a specific implementation, processing unit 82 is used to determine target action indication information, wherein the target action indication information is used to instruct the target vehicle to perform an action. Transceiver unit 81 is used to send the target action indication information to the server, wherein the target action indication information is used by the server to determine control information, and the control information is used to control the target vehicle to perform the target vehicle action.

[0161] In one possible implementation, the processing unit 82 is further configured to determine target action instruction information based on target screen operation information detected in the target screen area.

[0162] In one possible implementation, the terminal device includes multiple screen areas, including a target screen area. Each screen area in the multiple screen areas corresponds to different action indication information. The different action indication information is used to indicate different vehicle actions. The terminal device generates action indication information corresponding to any screen area when it detects screen operation information corresponding to any screen area through any screen area in the multiple screen areas.

[0163] In one possible implementation, the processing unit 82 is further configured to determine target action instruction information based on the user's gesture information and a gesture control set, wherein the gesture control set includes at least one gesture information and vehicle actions corresponding to each gesture information in the at least one gesture information.

[0164] In one possible implementation, processing unit 82 is further configured to generate first reminder information, wherein the first reminder information is used to determine whether the user agrees to the target vehicle performing the target vehicle action. Processing unit 82 is further configured to, if it is determined from the first reminder information that the user agrees to the target vehicle performing the target vehicle action, send target action instruction information to the server.

[0165] In one possible implementation, vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0166] In some feasible implementations, the interactive device 80 may correspond to the target vehicle 13 described above, or to a component (such as a circuit, chip, or chip system) configured in the target vehicle 13.

[0167] In a specific implementation, the transceiver unit 81 is used to receive control information from the server, wherein the control information is determined by the target action indication information of the terminal device, and the target action indication information is used to instruct the target vehicle to perform actions. The processing unit 82 is used to execute the target vehicle actions according to the control information.

[0168] In one possible implementation, the processing unit 82 is further configured to send a second reminder message to the terminal device if it is determined that an obstacle exists in the vehicle's blind spot. The processing unit 82 is also configured to execute the target vehicle action according to the control information if it is determined from the terminal device's response to the second reminder message that the user agrees to the vehicle performing the target vehicle action.

[0169] In one possible implementation, vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

[0170] Please see Figure 9 , Figure 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this application. The electronic device can be a terminal device, server, or target vehicle as described in the above embodiments, and can be used to implement the steps of the interaction method executed by the terminal device, server, or target vehicle as described in the above embodiments. The electronic device may include: a processor 91, a memory 92, and a bus system 93.

[0171] The memory 92 includes, but is not limited to, RAM, ROM, EPROM, or CD-ROM, and is used to store related instructions and data. The memory 92 stores executable modules or data structures, or subsets thereof, or extended sets thereof:

[0172] Operation instructions: This includes various operation instructions used to perform various operations.

[0173] Operating system: includes various system programs used to implement various basic business functions and handle hardware-based tasks.

[0174] Figure 9 Only one memory is shown in the image; of course, multiple memory can be configured as needed.

[0175] like Figure 9 As shown, the electronic device may further include an input / output device 94, which may be a communication module or a transceiver circuit. In the embodiments of this application, the input / output device 94 is used to perform the transmission and reception process of control information and other data or signaling involved in the embodiments.

[0176] Processor 91 may be a controller, CPU, general-purpose processor, DSP, ASIC, FPGA, or other programmable logic device, transistor logic device, hardware component, or any combination thereof. It may implement or execute the various exemplary logic blocks, modules, and circuits described in connection with the embodiments of this application. Processor 91 may also be a combination that implements computing functions, such as including one or more microprocessor combinations, a combination of DSP and microprocessor, etc.

[0177] In practical applications, the various components of an electronic device are coupled together through a bus system 93. This bus system 93 includes not only a data bus but may also include a power bus, a control bus, and a status signal bus. However, for clarity, in... Figure 9 The various buses are all labeled as Bus System 93. For ease of representation, in... Figure 9 The image shown is only schematic.

[0178] It should be noted that in practical applications, the processor in the embodiments of this application can be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method embodiments can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor described above can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application.

[0179] It is understood that the memory in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. The non-volatile memory can be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory can be random access memory (RAM), which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous linked dynamic random access memory (SLDRAM), and direct rambus RAM (DR RAM). It should be noted that the memories described in the embodiments of this application are intended to include, but are not limited to, these and any other suitable types of memory.

[0180] This application also provides a server, which may include a memory and a processor. The memory may store a computer program, and when the processor executes the computer program, it can implement the methods or steps performed by the server in the above embodiments.

[0181] This application also provides a terminal device, which may include a memory and a processor. The memory may store a computer program, and when the processor executes the computer program, it can implement the methods or steps performed by the terminal device in the above embodiments.

[0182] This application also provides a vehicle controller, which may include a memory and a processor. The memory may store a computer program, and the processor, when executing the computer program, can implement the methods or steps performed by the vehicle in the above embodiments.

[0183] This application also provides an interactive system, which may include the server and controller described above. The server can be used to execute the methods or steps executed by the server in the above embodiments, and the controller can be used to execute the methods or steps executed by the vehicle in the above embodiments.

[0184] Optionally, the interactive system may also include a terminal device, which can be used to implement the methods or steps executed by the terminal device in the above embodiments.

[0185] This application also provides a computer-readable storage medium storing a computer program thereon, which, when executed by a computer, implements the methods or steps performed by the terminal device, server, or target vehicle in the above embodiments.

[0186] This application also provides a computer program product that, when executed by a computer, implements the methods or steps performed by the terminal device, server, or target vehicle described above.

[0187] This application also provides a vehicle that may include the controller described above, for implementing the methods or steps performed by the vehicle in the preceding embodiments.

[0188] It should be noted that, for the sake of simplicity, each of the above-described embodiments of the interaction method is described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions involved are not necessarily essential to this application.

[0189] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps is not limited to the steps listed, but may optionally include steps not listed, or may optionally include other steps inherent to these processes, methods, products, or apparatuses.

[0190] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0191] Although this application has been described herein in conjunction with various embodiments, those skilled in the art, by reviewing the accompanying drawings, the disclosure, and the appended claims, will understand and implement other variations of the disclosed embodiments in carrying out this application. In the claims, the word "comprising" does not exclude other components or steps, and "a" or "an" does not exclude multiple instances. While different dependent claims may recite certain measures, this does not imply that these measures cannot be combined to produce a good effect.

[0192] Those skilled in the art will understand that all or part of the steps in the various methods of any of the above-described interaction methods can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage device, which may include: a flash drive, a read-only memory (ROM), a random access memory (RAM), a disk, or an optical disk, etc.

[0193] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of an interactive method, apparatus, system, vehicle, and related devices of this application. The descriptions of the embodiments above are intended to help understand the methods and core ideas of this application. At the same time, for those skilled in the art, based on the ideas of an interactive method, apparatus, system, vehicle, and related devices of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

[0194] Those skilled in the art will recognize that, in one or more of the examples above, the functions described in this application can be implemented using hardware, software, firmware, or any combination thereof. When implemented in software, these functions can be stored in a computer-readable medium or transmitted as one or more instructions or codes on a computer-readable medium. Computer-readable media include computer storage media and communication media, wherein communication media include any medium that facilitates the transmission of a computer program from one place to another. Storage media can be any available medium accessible to a general-purpose or special-purpose computer.

[0195] The specific embodiments described above further illustrate the purpose, technical solution, and beneficial effects of this application. It should be understood that the above description is only a specific embodiment of this application and is not intended to limit the scope of protection of this application. Any modifications, equivalent substitutions, improvements, etc., made on the basis of the technical solution of this application should be included within the scope of protection of this application.

Claims

1. An interaction method, characterized in that, Applied to a server, the method includes: Receive target action indication information from terminal device, wherein the target action indication information is used to indicate the action of target vehicle; Send control information to the target vehicle, wherein the control information is used to control the target vehicle to perform the target vehicle action; Wherein, the terminal device is in a locked screen state, and the target action indication information is generated by the terminal device when it detects the target screen operation information corresponding to the target screen area through the target screen area; The terminal device includes multiple screen areas, including the target screen area. Each screen area in the multiple screen areas corresponds to different action indication information. The different action indication information is used to indicate different vehicle actions. When the terminal device detects screen operation information corresponding to any screen area through any screen area in the multiple screen areas, it generates action indication information corresponding to any screen area.

2. The method according to claim 1, characterized in that, The target action instruction information is generated by the terminal device based on the user's gesture information and a gesture control set, wherein the gesture control set includes at least one gesture information and the vehicle action corresponding to each gesture information in the at least one gesture information.

3. The method according to claim 1 or 2, characterized in that, Sending control information to the target vehicle includes: Determine a first distance between the terminal device and the target vehicle; If it is determined that the first distance is within the preset distance range, control information is sent to the target vehicle.

4. The method according to claim 1 or 2, characterized in that, Sending control information to the target vehicle includes: Determine a first distance between the terminal device and the target vehicle; Receive a second distance from the terminal device, wherein the second distance is determined by the terminal device and is the distance between the terminal device and the target vehicle; If it is determined that both the first distance and the second distance are within the preset distance range, then control information is sent to the target vehicle.

5. The method according to any one of claims 1-4, characterized in that, Vehicle actions include at least unlocking the doors, locking the doors, folding the exterior mirrors, unfolding the exterior mirrors, closing the windows, opening the windows, opening the power tailgate, closing the power tailgate, activating the automatic parking function, or activating the autonomous vehicle summoning function.

6. An interaction method, characterized in that, Applied to a terminal device, the method includes: Determine target action indication information, wherein the target action indication information is used to indicate the action of the target vehicle; Send target action indication information to the server, wherein the target action indication information is used by the server to determine control information, and the control information is used to control the target vehicle to perform the target vehicle action; Wherein, the terminal device is in a locked state, and the determination of the target action indication information includes: Target action instruction information is determined based on the target screen operation information detected in the target screen area; The terminal device includes multiple screen areas, including the target screen area. Each screen area in the multiple screen areas corresponds to different action indication information. The different action indication information is used to indicate different vehicle actions. When the terminal device detects screen operation information corresponding to any screen area through any screen area in the multiple screen areas, it generates action indication information corresponding to any screen area.

7. The method according to claim 6, characterized in that, The determined target action instruction information includes: The target action instruction information is determined based on the user's gesture information and the gesture control set, wherein the gesture control set includes at least one gesture information and the vehicle action corresponding to each gesture information in the at least one gesture information.

8. The method according to claim 6 or 7, characterized in that, Sending the target action instruction information to the server includes: Generate a first reminder message, wherein the first reminder message is used to determine whether the user agrees to the target vehicle performing the target vehicle action; If the user agrees to the target vehicle performing the target vehicle action based on the first reminder information, then a target action instruction information is sent to the server.

9. An interaction method, characterized in that, Applied to vehicles, the method includes: Receive control information from the server, wherein the control information is determined by target action indication information of the terminal device, and the target action indication information is used to instruct the target vehicle to perform actions; The target vehicle action is executed according to the control information; Wherein, the terminal device is in a locked screen state, and the target action indication information is generated by the terminal device when it detects the target screen operation information corresponding to the target screen area through the target screen area; The terminal device includes multiple screen areas, including the target screen area. Each screen area in the multiple screen areas corresponds to different action indication information. The different action indication information is used to indicate different vehicle actions. When the terminal device detects screen operation information corresponding to any screen area through any screen area in the multiple screen areas, it generates action indication information corresponding to any screen area.

10. The method according to claim 9, characterized in that, The target vehicle's action is to unlock its doors. Executing the target vehicle's action according to the control information includes: If it is determined that there is an obstacle in the blind spot of the vehicle, a second reminder message is sent to the terminal device; If the terminal device determines that the user agrees to the vehicle performing the target vehicle action based on the response to the second reminder information, then the target vehicle action is performed based on the control information.

11. A server, characterized in that, It includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the interaction method as described in any one of claims 1-5.

12. A terminal device, characterized in that, It includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the interaction method as described in any one of claims 6-8.

13. A vehicle controller, characterized in that, It includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the interaction method of claim 9 or 10.

14. An interactive system, characterized in that, The interactive system includes the server of claim 11 and the controller of claim 13.

15. The interactive system according to claim 14, characterized in that, The interactive system also includes the terminal device as described in claim 12.

16. A vehicle, characterized in that, Includes the controller as described in claim 13.

17. A computer-readable storage medium, characterized in that, Used to store a computer program, which, when executed by a processor, implements the interaction method as described in any one of claims 1-5, or the interaction method as described in any one of claims 6-8, or the interaction method as described in claim 9 or 10.

Images