A vehicle remote control method, device, equipment and storage medium

By recognizing voice information and generating vehicle control commands through smart speakers, the problem of inconvenient remote vehicle control has been solved, enabling convenient and accurate remote operation and improving the user experience.

CN114360554BActive Publication Date: 2026-04-07APOLLO INTELLIGENT CONNECTIVITY (BEIJING) TECH CO LTD
View PDF 3 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-12-27
Publication Date
2026-04-07

AI Technical Summary

Technical Problem

In the existing technology, remote control of vehicles is inconvenient, and users cannot operate the vehicle in a convenient way from a distance.

Method used

By recognizing voice information through smart speakers, determining vehicle control events, and generating vehicle control commands, remote control of the target vehicle can be achieved, and the commands can be executed using vehicle control tools or a remote server.

Benefits of technology

It improves the convenience of remote vehicle control, enhances user satisfaction, and ensures the accuracy and safety of operation.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114360554B_ABST
    Figure CN114360554B_ABST
Patent Text Reader

Abstract

This disclosure provides a method, apparatus, device, and storage medium for remote vehicle control, relating to the field of artificial intelligence technology, specifically to the fields of vehicle networking and smart cockpits. The specific implementation scheme is as follows: if a vehicle control event is recognized based on voice information, the target vehicle to be controlled is determined; based on the voice information, a vehicle control command is determined; and based on the vehicle control command, the target vehicle is controlled. This technical solution achieves remote vehicle control through voice, increasing convenience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of artificial intelligence technology, and in particular to the fields of vehicle networking and smart cockpit, and includes a method, device, equipment and storage medium for remote vehicle control. Background Technology

[0002] With the development of artificial intelligence technology, vehicles are becoming increasingly intelligent. To meet the diverse needs of users, there is an urgent need for a convenient way to remotely control vehicles. Summary of the Invention

[0003] This disclosure provides a method, apparatus, device, and storage medium for remote vehicle control.

[0004] According to one aspect of this disclosure, a method for remotely controlling a vehicle is provided, the method comprising:

[0005] If a vehicle control event is identified based on the voice information, the target vehicle to be controlled is determined.

[0006] Based on the voice information, determine the vehicle control command;

[0007] The target vehicle is controlled according to the vehicle control command.

[0008] According to another aspect of this disclosure, an electronic device is provided, the electronic device comprising:

[0009] At least one processor; and

[0010] A memory communicatively connected to the at least one processor; wherein,

[0011] The memory stores instructions that can be executed by the at least one processor, which, when executed, enable the at least one processor to perform the vehicle remote control method according to any embodiment of this disclosure.

[0012] According to another aspect of this disclosure, a non-transitory computer-readable storage medium is provided storing computer instructions, wherein the computer instructions are used to cause a computer to perform the vehicle remote control method described in any embodiment of this disclosure.

[0013] According to the technology disclosed herein, remote vehicle control via voice increases convenience and improves user satisfaction.

[0014] It should be understood that the description in this section is not intended to identify key or essential features of the embodiments of this disclosure, nor is it intended to limit the scope of this disclosure. Other features of this disclosure will become readily apparent from the following description. Attached Figure Description

[0015] The accompanying drawings are provided to better understand this solution and do not constitute a limitation of this disclosure. Wherein:

[0016] Figure 1 This is a flowchart of a vehicle remote control method provided according to an embodiment of the present disclosure;

[0017] Figure 2 This is a flowchart of another vehicle remote control method provided according to an embodiment of the present disclosure;

[0018] Figure 3 This is a flowchart of yet another vehicle remote control method provided according to an embodiment of the present disclosure;

[0019] Figure 4 This is a flowchart of yet another vehicle remote control method provided according to an embodiment of the present disclosure;

[0020] Figure 5 This is a flowchart of another vehicle remote control method provided according to an embodiment of the present disclosure;

[0021] Figure 6 This is a schematic diagram of a vehicle remote control interaction according to an embodiment of the present disclosure;

[0022] Figure 7 This is a schematic diagram of the structure of a vehicle remote control device according to an embodiment of the present disclosure;

[0023] Figure 8 This is a block diagram of an electronic device used to implement the vehicle remote control method of the embodiments of this disclosure. Detailed Implementation

[0024] The exemplary embodiments of this disclosure are described below with reference to the accompanying drawings, including various details of the embodiments to aid understanding, and should be considered merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of this disclosure. Similarly, for clarity and brevity, descriptions of well-known functions and structures are omitted in the following description.

[0025] Figure 1 This is a flowchart illustrating a vehicle remote control method according to an embodiment of this disclosure. This method is applicable to situations where a vehicle can be remotely controlled. Optionally, this embodiment uses a smart speaker to remotely control the vehicle; further, it uses a vehicle control tool within the smart speaker. Optionally, the vehicle control tool configured in the smart speaker can be a general-purpose tool, capable of remotely controlling any vehicle authenticated by the user; or, the smart speaker can be configured with multiple vehicle control tools, each supporting remote control of a specific brand of vehicle.

[0026] Furthermore, the smart speaker in this embodiment can be a smart device equipped with a display unit and having functions such as voice interaction.

[0027] This method can be executed by a vehicle remote control device, which can be implemented in software and / or hardware and integrated into electronic devices configured with vehicle remote control functionality, such as smart speakers. Figure 1 As shown, the vehicle remote control method of this embodiment may include:

[0028] S101, if a vehicle control event is identified based on the voice information, the target vehicle to be controlled is determined.

[0029] In this embodiment, a vehicle control event refers to an event involving remote control of a vehicle. Optionally, when a user has a need to remotely control the vehicle, they can send voice information to a smart speaker. After receiving the voice information, the smart speaker can recognize the voice information and obtain the text content associated with the voice information. If the user's intention is to remotely control the vehicle, then a vehicle control event is identified.

[0030] Optionally, upon recognizing a vehicle control event, the target vehicle to be controlled is determined. Further, there are several ways to determine the target vehicle. One possible method is to extract a vehicle identifier from the voice information and then determine the target vehicle based on the vehicle identifier. The vehicle identifier can uniquely identify the vehicle; it can be a license plate number or the vehicle's vehicle identification number (VIN). For example, if the voice information is "Please turn on the hazard lights of the vehicle with license plate number ××A02××", then the vehicle identifier is ××A02××, and the vehicle with the vehicle identifier ××A02×× is thus identified as the target vehicle.

[0031] Another optional approach is to determine the target vehicle to be controlled based on historical interaction information. Specifically, if the smart speaker fails to extract the vehicle identifier from the voice information, it can determine the target vehicle to be controlled based on the content related to historical interaction information in the voice information. The historical interaction information can include interaction records between the smart speaker and the user over a period of time. Considering factors such as memory resource consumption, in this embodiment, the historical interaction information is preferably the interaction information between the smart speaker and the user based on the previous voice information. Specifically, it can include the previous voice information input by the user to the smart speaker, and the vehicle previously controlled by the smart speaker based on the previous voice information. The so-called previous voice information refers to the voice information input by the user to the smart speaker before inputting the voice information in S101.

[0032] For example, if the voice message is "Close the sunroof", and the previous voice message in the historical interaction information is "Please close the sunroof of vehicle with license plate number ××A02××", then the vehicle that was remotely controlled last time was the vehicle with license plate number ××A02××. Therefore, the target vehicle to be controlled is determined to be vehicle ××A02××.

[0033] Furthermore, as an optional embodiment of this disclosure, before recognizing a vehicle control event based on voice information, the method further includes: acquiring a wake-up voice and performing an operation to wake up the smart speaker based on the wake-up voice.

[0034] S102 determines the vehicle control command based on the voice information.

[0035] In this embodiment, vehicle control commands refer to commands used for remotely controlling the vehicle.

[0036] Specifically, the system can recognize voice information to obtain the corresponding text content, select control content related to vehicle control from the text content, and then generate vehicle control commands based on the control content. For example, if the voice information is "Please turn on the air conditioner of vehicle with license plate number ××A03××", the obtained control content will be "Turn on the air conditioner", and a vehicle control command to turn on the air conditioner will be generated.

[0037] S103 controls the target vehicle according to the vehicle control command.

[0038] Specifically, after determining the vehicle control command and the target vehicle to be controlled, the target vehicle can be controlled according to the vehicle control command. For example, a smart speaker, based on the vehicle control tool configured on it, can remotely control the target vehicle according to the vehicle control command. Alternatively, the smart speaker can send the vehicle control command to the remote server corresponding to the vehicle control tool configured on it, such as the vehicle manufacturer's TSP (Telematics Service Provider) server, so that the vehicle manufacturer's TSP server can remotely control the target vehicle according to the vehicle control command.

[0039] The vehicle control tools are provided by the vehicle manufacturer, i.e., the car factory.

[0040] It should be noted that current vehicle control requires users to be within a certain range of the vehicle and manually operate control buttons, which is inconvenient. Furthermore, if the vehicle and user are in different locations or far apart—for example, the user is in the office and the vehicle is in an underground parking lot—the current methods cannot remotely control the vehicle to turn off the air conditioning. This invention, however, uses a smart speaker as an interaction medium, enabling remote vehicle control via voice, greatly increasing convenience and significantly improving user satisfaction.

[0041] The technical solution provided in this disclosure identifies the target vehicle to be controlled by recognizing vehicle control events based on voice information, then determines the vehicle control command based on the voice information, and finally controls the target vehicle according to the vehicle control command. Compared with the existing method of vehicle control through manual operation, this disclosure achieves remote vehicle control through voice, which increases convenience.

[0042] Based on the above embodiments, as an optional approach of this disclosure, the execution result of the target vehicle's vehicle control command can also be obtained and displayed.

[0043] The execution result can include success or failure information. For example, a success message could be that the sunroof was successfully closed; a failure message could be that the window was not successfully opened.

[0044] Specifically, the system obtains the execution results of the vehicle control commands from the target vehicle and displays these results. Optionally, the execution results can be displayed on the smart speaker's screen. Furthermore, the execution results can be read aloud via voice. Additionally, the execution results can be sent via SMS to the mobile terminal (such as a mobile phone) of the user associated with the smart speaker.

[0045] Understandably, displaying the execution results allows users to intuitively understand how the target vehicle executes vehicle control commands.

[0046] Figure 2 This is a flowchart of another vehicle remote control method provided according to an embodiment of this disclosure. Based on the above embodiments, the "determining the target vehicle to be controlled" is further optimized, providing an optional implementation scheme. Figure 2 As shown, the vehicle remote control method of this embodiment may include:

[0047] S201, if a vehicle control event is recognized based on the voice information, then the target vehicle is determined from the candidate vehicles based on the control interface status of the candidate vehicles associated with the smart speaker.

[0048] In this embodiment, the smart speaker's account is bound to the vehicle control tool's account, and one or more vehicles can be bound to the vehicle control tool. Furthermore, vehicles under the vehicle control tool bound to the smart speaker can be used as candidate vehicles. For example, if the smart speaker's account is bound to account A of the vehicle control tool, and account A has vehicle 1 and vehicle 2 bound to it, then vehicle 1 and vehicle 2 can be used as candidate vehicles associated with the smart speaker.

[0049] Optionally, different candidate vehicles have different control interfaces. For each candidate vehicle, a control interface can be generated based on the manufacturer's common interface template and the vehicle's data. The control interface serves as the bridge for remote vehicle control. Furthermore, since the vehicle control tool is integrated into a smart speaker, the smart speaker can display the control interface. If it detects user clicks on the control interface or recognizes control options corresponding to user voice messages, it sends corresponding control commands to the remote server via the vehicle control tool. This allows the remote server to control the vehicle corresponding to the control interface based on the commands. In other words, the control interface is the medium through which the smart speaker interacts with the remote server to achieve remote vehicle control.

[0050] The control interface status can include the status of the control interfaces of candidate vehicles associated with the smart speaker when a vehicle control event is detected. Optionally, the control interface status can include a running state and a closed state. Further, the running state can include a currently displayed state and a background running state.

[0051] In one alternative approach, the control interface displayed on the smart speaker screen when a vehicle control event is detected can be used as the target interface, and then the candidate vehicle corresponding to the target interface can be used as the target vehicle.

[0052] Alternatively, the control interface displayed on the smart speaker screen when a vehicle control event is detected, as well as the interface running in the background at that time, can be used as the target interface, and then the candidate vehicle corresponding to the target interface can be used as the target vehicle.

[0053] Another alternative approach is to determine the target vehicle from the candidate vehicles based on the control interface status of the candidate vehicles associated with the smart speaker and historical interaction information. In this embodiment, the historical interaction information preferably includes the previous voice input by the user to the smart speaker and the content output by the smart speaker to the user based on the parsing result of the previous voice input.

[0054] For example, it can be determined whether the control interface currently displayed on the smart speaker screen is the same as the control interface displayed by the smart speaker after responding to the user's previous voice message when a vehicle control event is detected. If they are the same, the control interface currently displayed on the smart speaker screen is taken as the target interface; otherwise, both the control interface currently displayed on the smart speaker screen and the control interface displayed by the smart speaker after responding to the user's previous voice message are taken as the target interface. The candidate vehicle corresponding to the target interface is taken as the target vehicle.

[0055] S202 determines vehicle control commands based on voice information.

[0056] S203 controls the target vehicle according to the vehicle control command.

[0057] The technical solution of this disclosure involves identifying a vehicle control event based on voice information, determining the target vehicle from the candidate vehicles based on the control interface status of the candidate vehicles associated with the smart speaker, then determining the vehicle control command based on the voice information, and finally controlling the target vehicle according to the vehicle control command. This technical solution, by determining the target vehicle through the interface control status, can more accurately and reasonably identify the vehicle the user wants to remotely control, thus improving user satisfaction.

[0058] Figure 3 This is a flowchart of another vehicle remote control method provided according to an embodiment of this disclosure. Based on the above embodiments, the "determining the target vehicle to be controlled" is further optimized, providing an optional implementation scheme. For example... Figure 3 As shown, the vehicle remote control method of this embodiment may include:

[0059] S301, if a vehicle control event is identified based on the voice information, then the target voiceprint features are determined based on the voice information.

[0060] In this embodiment, the target voiceprint feature refers to the voiceprint feature corresponding to the voice information of the target user. Optionally, the target voiceprint feature can be obtained based on the voice information using a machine learning algorithm.

[0061] Specifically, after recognizing a vehicle control event, the voice information can be input into a voiceprint feature extraction model. After processing by the model, the target voiceprint features are obtained. The voiceprint feature extraction model can be a pre-trained machine learning model.

[0062] S302, based on the binding relationship between voiceprint features and vehicles, the target vehicle is determined according to the target voiceprint features.

[0063] In this embodiment, the binding relationship between voiceprint features and the vehicle refers to the pre-set relationship by the user in the smart speaker based on the vehicle identification and voice information. For example, when binding the smart speaker to the vehicle, the user's input voice information is obtained, the voiceprint features are acquired, the voiceprint features are bound to the vehicle identification, and the binding relationship is stored locally. Alternatively, the binding relationship can be stored in a cloud server associated with the smart speaker.

[0064] Specifically, the target voiceprint feature can be used as an index to find the vehicle corresponding to the target voiceprint feature from the binding relationship between the voiceprint feature and the vehicle, and the found vehicle can be used as the target vehicle.

[0065] Optionally, in complex scenarios such as multi-person conversations where multiple people are speaking simultaneously, various voice information and multiple voiceprint features will be generated, making it impossible to determine the target voiceprint feature. Therefore, an image acquisition unit can be configured in the smart speaker to capture images of people in the user's scene, and then the target vehicle can be determined based on the images and voiceprint features.

[0066] One alternative approach is to determine the distance between each person and the smart speaker based on their image. Then, combining the distance with each person's voiceprint characteristics, a target voiceprint feature is determined. Finally, based on the binding relationship between the voiceprint feature and the vehicle, the target vehicle is determined. Alternatively, the voiceprint feature of the person closest to the smart speaker can be used as the target voiceprint feature. Then, based on the binding relationship between the voiceprint feature and the vehicle, the target vehicle is determined.

[0067] Another alternative is to predetermine the binding relationship between the user's facial image and the smart speaker, then perform facial recognition based on the image to identify the target user associated with the smart speaker, use the target user's voiceprint features as the target voiceprint features, and then determine the target vehicle based on the binding relationship between the voiceprint features and the vehicle.

[0068] S302 determines vehicle control commands based on voice information.

[0069] S303 controls the target vehicle according to vehicle control commands.

[0070] The technical solution of this disclosure involves identifying a vehicle control event based on voice information, determining the target voiceprint feature based on the voice information, and determining the target vehicle based on the binding relationship between the voiceprint feature and the vehicle. Then, based on the voice information, a vehicle control command is determined, and the target vehicle is controlled according to the vehicle control command. This technical solution, by using voiceprint features that characterize the user to determine the target vehicle, improves the accuracy and efficiency of vehicle determination, thereby enhancing user satisfaction.

[0071] Figure 4 This is a flowchart of another vehicle remote control method provided according to an embodiment of this disclosure. Based on the above embodiments, the "determining the target vehicle to be controlled" is further optimized, providing an optional implementation scheme. For example... Figure 4 As shown, the vehicle remote control method of this embodiment may include:

[0072] S401: If a vehicle control event is recognized based on voice information, output "controllable vehicle".

[0073] In this embodiment, a controllable vehicle refers to at least one vehicle that can be remotely controlled by the smart speaker.

[0074] Specifically, after recognizing a vehicle control event, the system outputs a controllable vehicle to the user.

[0075] Alternatively, the controllable vehicle can be displayed to the user as a list of images.

[0076] Another option is to provide controllable vehicle information to the user via voice.

[0077] S402, in response to the operation of selecting a controllable vehicle, selects a target vehicle from the controllable vehicles.

[0078] Specifically, it obtains the user's selection operation on the available vehicles and, in response to the selection operation on the controllable vehicles, selects the target vehicle from the available vehicles.

[0079] Alternatively, a user click operation on a list of images of selectable vehicles is obtained, and in response to the click operation, the vehicle clicked by the user is selected from the controllable vehicles as the target vehicle.

[0080] Another option is to obtain the user's voice command for the available vehicles, and in response to the voice command, select the vehicle corresponding to the voice command from the available vehicles as the target vehicle.

[0081] S402 determines vehicle control commands based on voice information.

[0082] S403 controls the target vehicle according to vehicle control commands.

[0083] The technical solution of this disclosure involves recognizing a vehicle control event based on voice information, outputting a controllable vehicle, and responding to a selection operation of the controllable vehicle by selecting a target vehicle from the controllable vehicles. Then, based on the voice information, a vehicle control command is determined, and the target vehicle is controlled according to the vehicle control command. This technical solution, by outputting the controllable vehicle to the user, allows the user to more intuitively understand the vehicles that can be remotely controlled, increasing convenience and thus improving user satisfaction.

[0084] Figure 5 This is a flowchart of another vehicle remote control method provided according to an embodiment of the present disclosure. Figure 6 This is a schematic diagram of a vehicle remote control interaction according to an embodiment of this disclosure. Based on the above embodiment, the "controlling the target vehicle according to vehicle control commands" is further optimized, providing an optional implementation scheme. Combined with... Figure 5 and Figure 6 The vehicle remote control method in this embodiment may include:

[0085] S501: If a vehicle control event is recognized based on voice information, the target vehicle to be controlled is determined.

[0086] S502 determines vehicle control commands based on voice information.

[0087] S503, obtain the control credentials associated with the target vehicle.

[0088] In this embodiment, the control credential refers to the credential through which a user can remotely control a vehicle using a smart speaker. Optionally, the smart speaker is equipped with a vehicle control tool from the car manufacturer. The user can open the login interface of the vehicle control tool, enter a username and password to log in, and thus trigger the authentication service of the vehicle control tool. Correspondingly, the car manufacturer's login authentication server, which owns the vehicle control tool, can authenticate the user's smart speaker account with the smart speaker developer based on the OAuth 2.0 license agreement. If the authentication is successful, the car manufacturer's login authentication server will send a login credential, i.e., a control credential, to the smart speaker developer. Furthermore, the control credential is stored in association with the vehicle.

[0089] Specifically, after identifying the target vehicle, the control credentials associated with the target vehicle are obtained.

[0090] S504 sends a vehicle control command carrying a control credential to a remote server, so that the remote server, after determining that the smart speaker has the authority to control the target vehicle based on the control credential, controls the target vehicle according to the vehicle control command.

[0091] In this embodiment, the remote server may include the vehicle manufacturer's TSP service.

[0092] Specifically, such as Figure 6 As shown, the smart speaker sends a vehicle control command carrying a control credential to the car manufacturer's TSP service. Correspondingly, upon receiving the vehicle control command, the car manufacturer's TSP service sends the control credential to the car manufacturer's login authentication server. Upon receiving the control credential, the car manufacturer's login authentication server verifies its validity and sends the authentication result back to the car manufacturer's TSP service. If the car manufacturer's TSP service determines that the smart speaker has the authority to control the target vehicle based on the authentication result, it sends the vehicle control command to the target vehicle. After the target vehicle executes the vehicle control command, it sends the execution result back to the car manufacturer's TSP service, which then sends the execution result back to the smart speaker.

[0093] The technical solution of this disclosure identifies the target vehicle to be controlled by recognizing a vehicle control event based on voice information. Then, based on the voice information, a vehicle control command is determined, and control credentials associated with the target vehicle are obtained. The vehicle control command carrying the control credentials is then sent to a remote server. This allows the remote server to control the target vehicle according to the vehicle control command, provided it determines that the smart speaker has the authority to control the target vehicle based on the control credentials. This technical solution introduces control credentials to verify whether the smart speaker has the specific authority to control the vehicle, preventing unauthorized user control or erroneous control due to misoperation, thereby improving user satisfaction.

[0094] Based on the above embodiments, as an optional method of this disclosure, controlling the target vehicle according to the vehicle control command can also involve outputting control query information for the target vehicle; if the response information to the control query information is confirmation information, then the target vehicle is controlled according to the vehicle control command.

[0095] The control query information refers to information that asks the user whether they need to remotely control the target vehicle. There are many ways to output the control query information, and this embodiment does not specifically limit this. For example, one optional method is to output the control query information for the target vehicle via voice. Specifically, a smart speaker can broadcast the control query voice to the user to confirm whether they want to control the target vehicle.

[0096] Another option is to display a control query interface to output control query information for the target vehicle. Specifically, after identifying the target vehicle to be controlled, the smart speaker can pop up a control query interface for the target vehicle on its display screen to ask the user whether to control the target vehicle.

[0097] Another option is to combine voice and a display control query interface to output control query information for the target vehicle.

[0098] Furthermore, if the response to the control query is a confirmation message, then the target vehicle is controlled according to the vehicle control command.

[0099] Optionally, if it is determined that the target vehicle needs to be controlled based on the user's response to the control inquiry voice, then the target vehicle is controlled according to the vehicle control command.

[0100] Alternatively, if the user's actions on the control interface determine that control of the target vehicle is required, then the target vehicle will be controlled according to the vehicle control command. For example, if the system detects that the user clicks "confirm" on the control interface, it determines that control of the target vehicle is required, and the target vehicle will be controlled according to the vehicle control command.

[0101] Understandably, asking users whether they want to control the target vehicle can prevent accidental loss of control due to user error, thereby improving user satisfaction.

[0102] Figure 7 This is a schematic diagram of a vehicle remote control device according to an embodiment of the present disclosure. The embodiments of the present disclosure are applicable to situations involving remote control of a vehicle. The device can be implemented using software and / or hardware and can be integrated into electronic devices configured with vehicle remote control functions, such as smart speakers. Figure 7 As shown, the vehicle remote control device 700 includes:

[0103] The target vehicle determination module 701 is used to determine the target vehicle to be controlled if a vehicle control event is recognized based on voice information.

[0104] The vehicle control command determination module 702 is used to determine the vehicle control command based on the voice information;

[0105] The vehicle control module 703 is used to control the target vehicle according to vehicle control commands.

[0106] The technical solution provided in this disclosure identifies the target vehicle to be controlled by recognizing vehicle control events based on voice information, then determines the vehicle control command based on the voice information, and finally controls the target vehicle according to the vehicle control command. Compared with the existing method of vehicle control through manual operation, this disclosure achieves remote vehicle control through voice, which increases convenience.

[0107] Furthermore, the target vehicle determination module 701 is specifically used for:

[0108] The target vehicle is determined from the candidate vehicles based on the control interface status of the candidate vehicles associated with the smart speaker.

[0109] Furthermore, the target vehicle determination module 701 is also specifically used for:

[0110] Based on the speech information, determine the target voiceprint features;

[0111] Based on the binding relationship between voiceprint features and vehicles, the target vehicle is determined according to the target voiceprint features.

[0112] Furthermore, the target vehicle determination module 701 is also specifically used for:

[0113] Output controllable vehicles;

[0114] In response to the selection operation of controllable vehicles, select the target vehicle from the controllable vehicles.

[0115] Furthermore, the vehicle control module 703 is specifically used for:

[0116] Obtain the control credentials associated with the target vehicle;

[0117] Send vehicle control commands carrying control credentials to the remote server so that the remote server can control the target vehicle according to the vehicle control commands if it determines that the smart speaker has the authority to control the target vehicle based on the control credentials.

[0118] Furthermore, the vehicle control module 703 is also specifically used for:

[0119] Output control query information for the target vehicle;

[0120] If the response to the control query is an acknowledgment, then the target vehicle is controlled according to the vehicle control command.

[0121] Furthermore, the device also includes:

[0122] The execution result acquisition module is used to acquire the execution results of the target vehicle in response to vehicle control commands;

[0123] The results display module is used to display the execution results.

[0124] The acquisition, storage, and application of voice data and vehicle data involved in the technical solution disclosed herein comply with relevant laws and regulations and do not violate public order and good morals.

[0125] According to embodiments of this disclosure, this disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0126] Figure 8 A schematic block diagram of an example electronic device 800 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely illustrative and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0127] like Figure 8As shown, the electronic device 800 includes a computing unit 801, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 802 or a computer program loaded from a storage unit 808 into a random access memory (RAM) 803. The RAM 803 may also store various programs and data required for the operation of the electronic device 800. The computing unit 801, ROM 802, and RAM 803 are interconnected via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0128] Multiple components in electronic device 800 are connected to I / O interface 805, including: input unit 806, such as keyboard, mouse, etc.; output unit 807, such as various types of displays, speakers, etc.; storage unit 808, such as disk, optical disk, etc.; and communication unit 809, such as network card, modem, wireless transceiver, etc. Communication unit 809 allows electronic device 800 to exchange information / data with other devices through computer networks such as the Internet and / or various telecommunications networks.

[0129] The computing unit 801 can be a variety of general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 801 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special-purpose artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 801 performs the various methods and processes described above, such as a vehicle remote control method. For example, in some embodiments, the vehicle remote control method may be implemented as a computer software program tangibly contained in a machine-readable medium, such as storage unit 808. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 800 via ROM 802 and / or communication unit 809. When the computer program is loaded into RAM 803 and executed by the computing unit 801, one or more steps of the vehicle remote control method described above may be performed. Alternatively, in other embodiments, the computing unit 801 may be configured to perform the vehicle remote control method by any other suitable means (e.g., by means of firmware).

[0130] Various embodiments of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field-programmable gate arrays (FPGAs), application-specific integrated circuits (ASICs), application-specific standard products (ASSPs), systems-on-a-chip (SoCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments may include implementations in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which may be a dedicated or general-purpose programmable processor, capable of receiving data and instructions from a storage system, at least one input device, and at least one output device, and transmitting data and instructions to the storage system, the at least one input device, and the at least one output device.

[0131] The program code used to implement the methods of this disclosure may be written in any combination of one or more programming languages. This program code may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable vehicle telecontrol device, such that when executed by the processor or controller, the program code causes the functions / operations specified in the flowcharts and / or block diagrams to be implemented. The program code may be executed entirely on a machine, partially on a machine, as a standalone software package partially on a machine and partially on a remote machine, or entirely on a remote machine or server.

[0132] In the context of this disclosure, a machine-readable medium can be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can be, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media include electrical connections based on one or more wires, portable computer disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.

[0133] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device for displaying information to the user (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor); and a keyboard and pointing device (e.g., a mouse or trackball) through which the user provides input to the computer. Other types of devices can also be used to provide interaction with the user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including sound input, voice input, or tactile input).

[0134] The systems and technologies described herein can be implemented in computing systems that include backend components (e.g., as a data server), or computing systems that include middleware components (e.g., an application server), or computing systems that include frontend components (e.g., a user computer with a graphical user interface or web browser through which a user can interact with embodiments of the systems and technologies described herein), or any combination of such backend, middleware, or frontend components. The components of the system can be interconnected via digital data communication of any form or medium (e.g., a communication network). Examples of communication networks include local area networks (LANs), wide area networks (WANs), and the Internet.

[0135] Computer systems can include clients and servers. Clients and servers are generally located far apart and typically interact through communication networks. The client-server relationship is created by computer programs running on the respective computers and having a client-server relationship with each other. The server can be a cloud server, also known as a cloud computing server or cloud host, which is a hosting product within the cloud computing service system to address the shortcomings of traditional physical hosts and VPS services, such as high management difficulty and weak business scalability.

[0136] Artificial intelligence (AI) is the study of enabling computers to simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, and planning). It encompasses both hardware and software technologies. AI hardware technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, and big data processing. AI software technologies mainly include computer vision, speech recognition, natural language processing, machine learning / deep learning, big data processing, and knowledge graph technologies.

[0137] Cloud computing refers to a technology system that enables access to a shared pool of physical or virtual resources via a network. These resources can include servers, operating systems, networks, software, applications, and storage devices, and can be deployed and managed on demand and in a self-service manner. Cloud computing technology can provide efficient and powerful data processing capabilities for applications such as artificial intelligence and blockchain, as well as for model training.

[0138] It should be understood that the various forms of processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be executed in parallel, sequentially, or in different orders, as long as the desired result of the technical solution disclosed in this disclosure can be achieved, and this is not limited herein.

[0139] The specific embodiments described above do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure should be included within the scope of protection of this disclosure.

Claims

1. A method for remotely controlling a vehicle, comprising: If a vehicle control event is identified based on voice information, the target vehicle to be controlled is determined. This determination includes: identifying the target vehicle from the candidate vehicles based on the control interface status of the candidate vehicles associated with the smart speaker and historical interaction information; wherein the historical interaction information consists of the previous voice information input by the user to the smart speaker and the content output by the smart speaker to the user based on the parsing result of the previous voice information; different candidate vehicles correspond to different control interfaces. Based on the control interface status of the candidate vehicles associated with the smart speaker and historical interaction information, the target vehicle is determined from the candidate vehicles, including: Determine whether the control interface currently displayed on the smart speaker screen when a vehicle control event is detected is the same as the control interface displayed by the smart speaker after responding to the user's previous voice message; if they are the same, then the control interface currently displayed on the smart speaker screen is taken as the target interface; and the candidate vehicle corresponding to the target interface is taken as the target vehicle. Based on the voice information, determine the vehicle control command; The target vehicle is controlled according to the vehicle control command; The process of determining the target vehicle to be controlled includes: Based on the images of the people, determine the distance between each person and the smart speaker; Based on the voice information of each person, determine the voiceprint characteristics of each person; Based on the distance and the voiceprint characteristics of each person, the target voiceprint characteristics are determined; Based on the binding relationship between voiceprint features and vehicles, the target vehicle is determined according to the target voiceprint features.

2. The method according to claim 1, wherein, The process of determining the target vehicle to be controlled includes: The target vehicle is determined from the candidate vehicles based on the control interface status of the candidate vehicles associated with the smart speaker.

3. The method according to claim 1, wherein, The process of determining the target vehicle to be controlled includes: Output controllable vehicles; In response to the selection operation of the controllable vehicle, a target vehicle is selected from the controllable vehicles.

4. The method according to claim 1, wherein, The step of controlling the target vehicle according to the vehicle control command includes: Obtain the control credentials associated with the target vehicle; Send a vehicle control command carrying the control credentials to a remote server, so that the remote server, after determining that the smart speaker has the authority to control the target vehicle based on the control credentials, controls the target vehicle according to the vehicle control command.

5. The method according to claim 1, wherein, The step of controlling the target vehicle according to the vehicle control command includes: Output control query information for the target vehicle; If the response to the control query is an acknowledgment, then the target vehicle is controlled according to the vehicle control command.

6. The method according to claim 1, further comprising: Obtain the execution result of the target vehicle in response to the vehicle control command; The execution results are then displayed.

7. A vehicle remote control device, comprising: The target vehicle determination module is used to determine the target vehicle to be controlled if a vehicle control event is identified based on voice information. The determination of the target vehicle includes: identifying the target vehicle from the candidate vehicles based on the control interface status of candidate vehicles associated with the smart speaker and historical interaction information; wherein the historical interaction information consists of the previous voice information input by the user to the smart speaker and the content output by the smart speaker to the user based on the parsing result of the previous voice information; different candidate vehicles correspond to different control interfaces. Based on the control interface status of the candidate vehicles associated with the smart speaker and historical interaction information, the target vehicle is determined from the candidate vehicles, including: Determine whether the control interface currently displayed on the smart speaker screen when a vehicle control event is detected is the same as the control interface displayed by the smart speaker after responding to the user's previous voice message; if they are the same, then the control interface currently displayed on the smart speaker screen is taken as the target interface; and the candidate vehicle corresponding to the target interface is taken as the target vehicle. The vehicle control command determination module is used to determine the vehicle control command based on the voice information; The vehicle control module is used to control the target vehicle according to the vehicle control command; The target vehicle determination module is also specifically used for: Based on the images of the people, determine the distance between each person and the smart speaker; Based on the voice information of each person, determine the voiceprint characteristics of each person; Based on the distance and the voiceprint characteristics of each person, the target voiceprint characteristics are determined; Based on the binding relationship between voiceprint features and vehicles, the target vehicle is determined according to the target voiceprint features.

8. The apparatus according to claim 7, wherein the target vehicle determination module is specifically used for: The target vehicle is determined from the candidate vehicles based on the control interface status of the candidate vehicles associated with the smart speaker.

9. The apparatus according to claim 7, wherein the target vehicle determination module is further specifically used for: Output controllable vehicles; In response to the selection operation of the controllable vehicle, a target vehicle is selected from the controllable vehicles.

10. The apparatus according to claim 7, wherein the vehicle control module is specifically used for: Obtain the control credentials associated with the target vehicle; Send a vehicle control command carrying the control credentials to a remote server, so that the remote server, after determining that the smart speaker has the authority to control the target vehicle based on the control credentials, controls the target vehicle according to the vehicle control command.

11. The apparatus according to claim 7, wherein the vehicle control module is further specifically used for: Output control query information for the target vehicle; If the response to the control query is an acknowledgment, then the target vehicle is controlled according to the vehicle control command.

12. The apparatus according to claim 7, further comprising: The execution result acquisition module is used to acquire the execution result of the target vehicle in response to the vehicle control command; The results display module is used to display the execution results.

13. An electronic device, comprising: At least one processor; as well as A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to enable the at least one processor to perform the vehicle remote control method according to any one of claims 1-6.

14. A non-transitory computer-readable storage medium storing computer instructions, wherein, The computer instructions are used to cause the computer to execute the vehicle remote control method according to any one of claims 1-6.

15. A computer program product comprising a computer program that, when executed by a processor, implements the vehicle remote control method according to any one of claims 1-6.

Citation Information

Patent Citations

  • Smart loudspeaker box vehicle control method and device

    CN108831478A

  • Vehicle control method and device, storage medium, electronic equipment and vehicle

    CN112298104A

  • Graphical User Interface for Mobile Phones

    CN305472786S