Voice-based remote vehicle control method and device, electronic equipment and storage medium

Abstract

The application provides a voice-based remote vehicle control method and device, electronic equipment and storage medium. The method comprises the following steps: in response to a digital person of any terminal in a plurality of terminals being woken up, receiving a user's vehicle control voice information through the woken-up digital person, performing intent recognition on the vehicle control voice information through the woken-up digital person, obtaining the user's vehicle control intent, and generating a structured vehicle control instruction according to the vehicle control intent; sending the vehicle control instruction to a cloud server through the woken-up digital person; receiving a vehicle control execution result sent by the cloud server through a digital person of at least one terminal in the plurality of terminals; and broadcasting the vehicle control execution result through the digital person of the at least one terminal. Thus, the present application can control a vehicle through voice, thereby reducing the operation threshold of remote control of the vehicle. After the vehicle control voice information is sent, the digital person can also broadcast the vehicle control execution result, thereby realizing timely feedback on the remote control of the vehicle.

Description

Technical Field

[0001] This application relates to the technical fields of intelligent cockpit, in-vehicle intelligent agent, digital human interaction, scene orchestration, etc., and in particular to a voice-based remote vehicle control method, device, electronic device and storage medium. Background Technology

[0002] Currently, remote vehicle control typically requires users to open the vehicle's dedicated application (APP), locate the corresponding function button, and click to operate. The entire process requires manual operation and is relatively cumbersome. Moreover, after performing the operation, users often do not know whether the vehicle has actually executed the required control function, lacking real-time feedback. Summary of the Invention

[0003] The purpose of this application is to at least partially solve one of the technical problems in the related art.

[0004] Therefore, the first objective of this application is to propose a voice-based remote vehicle control method to enable vehicle control via voice, thereby lowering the operational threshold for remote vehicle control. A digital human announces the control results, achieving timely feedback on remotely controlled vehicles.

[0005] The second objective of this application is to propose a voice-based remote vehicle control device.

[0006] The third objective of this application is to propose an electronic device.

[0007] The fourth objective of this application is to provide a computer-readable storage medium.

[0008] The fifth objective of this application is to provide a computer program product.

[0009] To achieve the above objectives, a first aspect of this application proposes a voice-based remote vehicle control method, comprising: responding to the wake-up of a digital human on any of a plurality of terminals; receiving vehicle control voice information from a user through the woken digital human, wherein the digital humans of the plurality of terminals have the same interaction interface; performing intent recognition on the vehicle control voice information through the woken digital human to obtain the user's vehicle control intent, and generating a structured vehicle control command based on the vehicle control intent; sending the vehicle control command to a cloud server through the woken digital human; receiving a vehicle control execution result sent by the cloud server through the digital human of at least one of the plurality of terminals; and broadcasting the vehicle control execution result through the digital human of at least one terminal.

[0010] To achieve the above objectives, the first aspect of this application proposes another voice-based remote vehicle control method, comprising: listening to information sent by a digital human of any of a plurality of terminals; in response to the listened information being a vehicle control command, forwarding the vehicle control command to a vehicle control system; receiving the vehicle control execution result of the vehicle executing the vehicle control command, and feeding back the vehicle control execution result to a digital human of at least one of the plurality of terminals.

[0011] To achieve the above objectives, the first aspect of this application proposes another voice-based remote vehicle control method, comprising: receiving a vehicle control command sent by a cloud server; calling a vehicle control server corresponding to the vehicle control command; executing the vehicle control command through the vehicle control server; and feeding back the vehicle control execution result of the vehicle control command to the cloud server.

[0012] To achieve the above objectives, a second aspect of this application proposes a voice-based remote vehicle control device, comprising: a first receiving module, configured to receive a user's vehicle control voice information via the awakened digital human of any of a plurality of terminals, wherein the digital humans of the plurality of terminals have the same interactive interface; an intent recognition module, configured to perform intent recognition on the vehicle control voice information via the awakened digital human, obtain the user's vehicle control intent, and generate a structured vehicle control command based on the vehicle control intent; a sending module, configured to send the vehicle control command to a cloud server via the awakened digital human; a second receiving module, configured to receive a vehicle control execution result sent by the cloud server via the digital human of at least one of the plurality of terminals; and a broadcasting module, configured to broadcast the vehicle control execution result via the digital human of at least one terminal.

[0013] To achieve the above objectives, a second aspect of this application proposes another voice-based remote vehicle control device, comprising: a monitoring module for monitoring information sent by a digital human at any of a plurality of terminals; a forwarding module for forwarding a vehicle control command to a vehicle control system in response to the monitored information being a vehicle control command; and a processing module for receiving the vehicle control execution result of the vehicle executing the vehicle control command and feeding back the vehicle control execution result to a digital human at at least one of the plurality of terminals.

[0014] To achieve the above objectives, a second aspect of this application proposes another voice-based remote vehicle control device, comprising: a receiving module for receiving vehicle control commands sent by a cloud server; a calling module for calling a vehicle control server corresponding to the vehicle control command; and an execution module for executing the vehicle control command through the vehicle control server and feeding back the vehicle control execution result of the vehicle control command to the cloud server.

[0015] To achieve the above objectives, a third aspect of this application provides an electronic device, including: a processor; and a memory communicatively connected to the processor; the memory stores computer-executable instructions; the processor executes the computer-executable instructions stored in the memory to enable the processor to execute the voice-based remote vehicle control method described in the first aspect of the application.

[0016] To achieve the above objectives, a fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, the computer instructions being used to cause the computer to execute the voice-based remote vehicle control method described in the above aspect of the embodiment.

[0017] To achieve the above objectives, a fifth aspect of this application provides a computer program product, including a computer program that, when executed by a processor, implements the voice-based remote vehicle control method described in the above aspect of the embodiment.

[0018] The voice-based remote vehicle control method, device, electronic equipment, and storage medium provided in this application respond to the wake-up of a digital human on any of multiple terminals. The woken digital human receives the user's voice control information, performs intent recognition on the voice information to obtain the user's control intent, and generates structured control commands based on the intent. The woken digital human sends the control commands to a cloud server and receives the control execution results from the cloud server, which are then broadcast through a digital human on at least one terminal. Therefore, this solution enables vehicle control via voice through natural language interaction with the digital human, lowering the operational threshold for remote vehicle control. The identical digital human on the vehicle and terminal sides improves the consistency of cross-terminal interaction. Furthermore, after issuing voice control information, the digital human can broadcast the control execution results, achieving timely feedback on remote vehicle control.

[0019] Additional aspects and advantages of this application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this application. Attached Figure Description

[0020] The above and / or additional aspects and advantages of this application will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, wherein:

[0021] Figure 1 A flowchart illustrating a voice-based remote vehicle control method provided in an embodiment of this application; Figure 2 A flowchart illustrating another voice-based remote vehicle control method provided in an embodiment of this application; Figure 3A flowchart illustrating another voice-based remote vehicle control method provided in an embodiment of this application; Figure 4 A flowchart illustrating another voice-based remote vehicle control method provided in an embodiment of this application; Figure 5 A flowchart illustrating another voice-based remote vehicle control method provided in an embodiment of this application; Figure 6 This is an architecture diagram of the voice-based remote vehicle control method provided in the embodiments of this application; Figure 7 A schematic diagram of the structure of a voice-based remote vehicle control device provided in an embodiment of this application; Figure 8 A schematic diagram of another voice-based remote vehicle control device provided in an embodiment of this application; Figure 9 This is a schematic diagram of another voice-based remote vehicle control device provided in an embodiment of this application. Detailed Implementation

[0022] The embodiments of this application are described in detail below. Examples of these embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this application, and should not be construed as limiting this application.

[0023] The following description, with reference to the accompanying drawings, describes a voice-based remote vehicle control method and apparatus according to embodiments of this application.

[0024] Figure 1 This is a flowchart illustrating a voice-based remote vehicle control method provided in an embodiment of this application, as shown below. Figure 1 As shown, the voice-based remote vehicle control method of this application includes, but is not limited to, the following steps: S101, in response to the digital human being being woken up on any of the multiple terminals, the user's voice control information is received through the woken digital human, wherein the digital humans of the multiple terminals have the same interaction interface.

[0025] It should be noted that multiple terminals can be mobile electronic devices or non-mobile electronic devices. For example, mobile electronic devices can be mobile phones, tablets, laptops, PDAs, in-vehicle electronic devices, wearable devices, and ultra-mobile personal computers (Ultra). Mobile electronic devices include mobile personal computers (UMPCs), netbooks, and personal digital assistants (PDAs), while non-mobile electronic devices can include personal computers (PCs), televisions, and other smart home devices. This application does not specifically limit the number of terminals.

[0026] In some embodiments, waking up the digital human on any terminal can be done by using a predefined wake-up word. In response to any terminal among multiple terminals receiving the wake-up word, it can be determined that the digital human on any terminal has been woken up.

[0027] In some embodiments, multiple terminals may simultaneously receive the wake word. Different terminals respond to the wake word at different speeds, and the terminal with the fastest response speed is selected as any terminal that wakes up the digital human.

[0028] In some embodiments, if the digital human on any terminal is awakened, the awakened digital human can respond to the user, for example, by broadcasting response information to inform the user that the digital human has been awakened. Furthermore, it can receive the user's voice control information.

[0029] In some embodiments, voice information collected within a set time period after the digital human broadcasts a response message can be used as the user's vehicle control voice information. Alternatively, voice information can be continuously detected after the digital human broadcasts a response message; if no voice information is detected within a set time period, the detected voice information can be used as the user's vehicle control voice information.

[0030] It should be noted that the digital humans on multiple terminals have the same interaction interface, enabling the awakened digital humans to perform the same actions, such as receiving and recognizing vehicle control voice information. Furthermore, different terminals can also render the same digital human appearance.

[0031] S102 uses the awakened digital human to perform intent recognition on the vehicle control voice information, obtains the user's vehicle control intent, and generates structured vehicle control commands based on the vehicle control intent.

[0032] In some embodiments, the awakened digital human can invoke the intent recognition model of the terminal where the digital human is located to perform intent recognition on the vehicle control voice information, thereby obtaining the user's vehicle control intent. The user's vehicle control intent refers to controlling a target device on the vehicle to perform a target operation.

[0033] In other words, an intent recognition model can be used to identify the target device to be controlled from the vehicle control voice information, such as the air conditioner, windows, trunk, door locks, etc., and to identify the target operation type and target operation parameters of the target device as the user's vehicle control intent.

[0034] The intent recognition model can be a large language model. The target operation type can be on, off, setting parameters, querying status, etc.; the target operation parameter can be temperature value, opening percentage, etc.

[0035] In some embodiments, the vehicle control voice information can be first converted into corresponding text information, and the target device, target operation type and target operation parameters included in the text information can be extracted by a large language model.

[0036] Furthermore, the extracted target device, target operation type, and target operation parameters can be used as vehicle control intentions, and the vehicle control intentions can be structured to obtain vehicle control commands.

[0037] S103 sends vehicle control commands to the cloud server via a woken-up digital human.

[0038] In some embodiments, the vehicle control command is used to control the vehicle. The terminal and the vehicle communicate based on a cloud server. The vehicle control command can be sent to the cloud server by the awakened digital human, and the cloud server will forward the vehicle control command to the vehicle to control the vehicle and obtain the vehicle control execution result corresponding to the vehicle control command.

[0039] S104, through a digital human on at least one of multiple terminals, receives the vehicle control execution result sent by the cloud server.

[0040] In some embodiments, since there are multiple terminals, the cloud server can send the vehicle control command corresponding to the vehicle control execution result to the digital person of each of the multiple terminals, and can also send the vehicle control command corresponding to the vehicle control execution result to the digital person of at least one of the multiple terminals.

[0041] In other words, a digital human can receive vehicle control execution results sent by a cloud server through at least one of multiple terminals.

[0042] In this case, when the digital human of at least one of the multiple terminals receives the vehicle control execution result sent by the cloud server and needs to broadcast the execution result, the digital human to be broadcast can be determined first as the digital human of at least one terminal.

[0043] In some embodiments, since the digital persona of at least one of the multiple terminals passively receives the vehicle control execution result sent by the cloud server, the digital persona of at least one terminal is determined by the cloud server. That is, the cloud server can determine the digital persona that makes the broadcast as the digital persona of at least one terminal, and send the vehicle control execution result to the digital persona of at least one terminal.

[0044] S105, the results of vehicle control are broadcast through a digital human at at least one terminal.

[0045] In some embodiments, when at least one terminal's digital human receives the vehicle control execution result sent by the cloud server, it can generate natural language broadcast information based on the vehicle control execution result and broadcast the information.

[0046] For example, if the vehicle control command is: "Turn on the air conditioning in the car and keep the temperature at 22 degrees Celsius," the result could be: "Air conditioning is on, and the temperature is set to 22 degrees Celsius." By performing natural language processing on the result, conversational or formal statements can be generated for broadcast.

[0047] The announcement could be: "The air conditioning is on, set to 22 degrees Celsius. The interior temperature is expected to reach the target temperature in 3 minutes."

[0048] In the voice-based remote vehicle control method provided in this application embodiment, in response to the wake-up of a digital human on any of multiple terminals, the woken digital human receives the user's vehicle control voice information, performs intent recognition on the voice information to obtain the user's vehicle control intent, and generates structured vehicle control commands based on the intent. The woken digital human sends the vehicle control commands to a cloud server and receives the vehicle control execution results sent by the cloud server, and broadcasts the vehicle control execution results through the digital human on at least one terminal. Therefore, this solution can achieve vehicle control via voice through natural language interaction with the digital human, lowering the operational threshold for remote vehicle control. The digital human on the vehicle end and the terminal end are identical, improving the consistency of cross-terminal interaction. Moreover, after issuing vehicle control voice information, the digital human can also broadcast the vehicle control execution results, achieving timely feedback on remote vehicle control.

[0049] Figure 2 A flowchart illustrating another voice-based remote vehicle control method provided in this application embodiment is shown below. Figure 2 As shown, the voice-based remote vehicle control method of this application includes, but is not limited to, the following steps: S201, in response to the digital human being being woken up on any of the multiple terminals, the user's voice control information is received through the woken digital human, wherein the digital humans of the multiple terminals have the same interaction interface.

[0050] In the embodiments of this application, step S201 can be implemented in any of the ways described in the embodiments of this application. This is not limited here and will not be described in detail.

[0051] S202, performs speech-to-text processing on the vehicle control voice information to obtain the corresponding text information.

[0052] S203 performs intent recognition on the text information to extract the target device, target operation type, and target operation parameters that need to be controlled in the vehicle.

[0053] In some embodiments, when the awakened digital human receives the user's vehicle control voice information, it can first perform speech-to-text processing on the vehicle control voice information to convert the speech into text and obtain the text information corresponding to the vehicle control voice information.

[0054] Optionally, the speech-to-text processing can be implemented using any of the relevant technologies, without any specific limitation.

[0055] In some embodiments, intent recognition refers to identifying the device in the vehicle that needs to be controlled, that is, identifying whether there is a device name in the text information, and using the identified device name as the target device in the vehicle that needs to be controlled.

[0056] In some embodiments, the names of devices included in the vehicle can be obtained in advance, and identified in text information based on these names. The devices corresponding to the identified names are then designated as target devices in the vehicle that need to be controlled. These devices include, but are not limited to, air conditioning, windows, trunk, and door locks.

[0057] Optionally, multiple names can be obtained for any given device to expand the scope of identification.

[0058] In some embodiments, controlling a vehicle requires not only identifying the target device to be controlled, but also determining the operation to be performed on the target device, such as the operation type and operation parameters.

[0059] The operation type can be on, off, setting parameters, querying status, etc.; the operation parameters can be temperature value, opening percentage, etc.

[0060] In other words, it can also identify the operation type contained in the text information as the target operation type, and identify the operation parameters contained in the text information as the target operation parameters.

[0061] S204 generates structured vehicle control commands based on the target device, target operation type, and target operation parameters.

[0062] In some embodiments, structured vehicle control commands can be obtained by setting a structured vehicle control command template and adding the identified target device, target operation type, and target operation parameters to the vehicle control command template.

[0063] In some embodiments, before adding to the vehicle control command template, the target device, target operation type, and target operation parameters can be structured, and the structured target device, target operation type, and target operation parameters can be added to the vehicle control command template.

[0064] In some embodiments, the target device, target operation type, and target operation parameters can be concatenated, and the concatenated target device, target operation type, and target operation parameters can be structured to obtain structured vehicle control commands.

[0065] In some embodiments, after the awakened digital human receives the vehicle control voice information, it can directly invoke the terminal's local intent recognition model to perform intent recognition in order to obtain the vehicle control command. However, the local intent recognition model can only recognize text information with explicit device, operation parameters, and operation types; it cannot recognize abstract text information.

[0066] For example, if the text message is: "It's too hot today," the local intent recognition model cannot identify the device, operation parameters, and operation type.

[0067] In some embodiments, vehicle control commands are sent to a cloud server. If the vehicle control command cannot be recognized on the terminal, text information and / or vehicle control voice information can be sent to the cloud server, which will then perform intent recognition on the abstract text information and / or vehicle control voice information, thereby improving the flexibility and accuracy of intent recognition.

[0068] In other words, in response to the failure to extract at least one of the target device, target operation type, and target operation parameters from the text information, the text information and / or vehicle control voice information are forwarded to the cloud server for intent recognition in order to obtain vehicle control commands.

[0069] S205 sends vehicle control commands to the cloud server via a woken-up digital human.

[0070] S206, through a digital human on at least one of multiple terminals, receives the vehicle control execution result sent by the cloud server.

[0071] S207, the results of vehicle control are broadcast through a digital human at at least one terminal.

[0072] In the embodiments of this application, steps S205-S207 can be implemented in any of the embodiments of this application, and no limitation is made here, nor will it be described in detail.

[0073] The voice-based remote vehicle control method provided in this application involves converting the voice control information to text to obtain corresponding text information. Intent recognition is then performed on the text information to extract the target device, target operation type, and target operation parameters to be controlled within the vehicle. Based on these parameters, structured vehicle control commands are generated. This method enables the extraction of explicit vehicle control commands from the voice control information. Furthermore, when the terminal cannot recognize the command, the cloud server performs intent recognition, improving the flexibility and accuracy of intent recognition.

[0074] Figure 3 A flowchart illustrating another voice-based remote vehicle control method provided in this application embodiment is shown below. Figure 3 As shown, the voice-based remote vehicle control method of this application includes, but is not limited to, the following steps: S301, in response to the wake-up of the digital human on any of the multiple terminals, receives the user's vehicle control voice information through the woken digital human, wherein the digital humans on the multiple terminals have the same interaction interface.

[0075] S302 uses a woken-up digital human to recognize the user's intent to control the vehicle through voice commands, obtain the user's intent to control the vehicle, and generate structured vehicle control commands based on the intent.

[0076] S303 sends vehicle control commands to the cloud server via a woken-up digital human.

[0077] In the embodiments of this application, steps S301-S303 can be implemented in any of the embodiments of this application, and no limitation is made here, nor will it be described in detail.

[0078] S304 receives the identity verification result of the terminal where the awakened digital human is located, sent by the cloud server.

[0079] S305, in response to the identity verification result indicating that the terminal has passed the identity verification, receives the vehicle control command sent by the cloud server through the digital human of at least one of the multiple terminals and executes the vehicle control result.

[0080] In some embodiments, to improve the security of cross-terminal interaction, after the awakened digital human sends the vehicle control command to the cloud server, the cloud server can also verify the identity of the terminal where the awakened digital human is located to verify whether the terminal's identity is compliant.

[0081] In some embodiments, the identity of a terminal can be verified based on its identification information. This verification can check whether the terminal's identification information exists in an identification information database, which includes identification information of terminals permitted to interact with the cloud server.

[0082] Optionally, if the terminal exists in the identification information database, it can be determined that the terminal has passed the identity verification; if it does not exist in the identification information database, it can be determined that the terminal has failed the identity verification.

[0083] In some embodiments, regardless of whether the terminal passes the identity verification, an identity verification result can be generated and received by the awakened digital human, thereby clarifying whether the terminal of the awakened digital human has passed the identity verification.

[0084] In some embodiments, the cloud server can forward vehicle control commands only after the terminal has passed identity verification, thereby obtaining the vehicle control execution result of the vehicle control command.

[0085] In some embodiments, the cloud server can also verify the terminal's permissions to determine whether the terminal can remotely control the vehicle. Optionally, the permission level of the terminal where the awakened digital human is located can be obtained; if the permission level is greater than a set level, it is determined that the terminal can remotely control the vehicle.

[0086] S306, through a digital human on at least one of multiple terminals, receives the vehicle control execution result sent by the cloud server.

[0087] In some embodiments, since multiple terminals can communicate with the cloud server, all terminals can receive the vehicle control execution results sent by the cloud server. To ensure that users can receive the digital human's broadcast of the vehicle control execution results, and to avoid all terminals' digital humans broadcasting vehicle control execution results simultaneously, thus avoiding resource waste.

[0088] Optionally, the digital person of at least one terminal performing the broadcast can be determined by the cloud server. The digital person of at least one terminal performing the broadcast can be determined based on the location information of each terminal.

[0089] In some embodiments, location information of multiple terminals can be sent to the cloud server based on a location reporting request. This location information is used by the cloud server to determine the digital human of at least one terminal that will be broadcasting.

[0090] In other words, after receiving the location information of multiple terminals, the cloud server can determine the digital human of at least one terminal to broadcast based on their respective location information.

[0091] For example, if multiple terminals, including mobile phones, smart home devices, and smartwatches, have different location information than the smart home devices and smartwatches, but the smartwatches have the same location information as the smart home devices, then the mobile phone can be selected as a digital human terminal for broadcasting.

[0092] S307, the results of vehicle control are broadcast through a digital human at at least one terminal.

[0093] In some embodiments, at least one terminal digital human can process the results of vehicle control execution and obtain broadcast information in natural language.

[0094] Optionally, since the vehicle control execution result is the result of executing the vehicle control voice information issued by the user, that is, the vehicle control execution result may include intent feedback information corresponding to the vehicle control intent. Based on the vehicle control execution result, intent feedback information corresponding to the vehicle control intent may be generated, and the intent feedback information may be broadcast through a digital human at at least one terminal.

[0095] In some embodiments, the intent feedback information is the same as the natural language broadcast information. This intent feedback information includes at least vehicle status information. For example, if the vehicle control command includes turning on the air conditioning, the intent feedback information could be "Air conditioning is on."

[0096] In the voice-based remote vehicle control method provided in this application embodiment, the identity verification result of the terminal where the woken-up digital human is located is received from the cloud server. When the terminal passes the identity verification, the vehicle control execution result sent by the cloud server can be received through the digital human of at least one of multiple terminals. Before forwarding the vehicle control command, the cloud server verifies the identity of the terminal sending the vehicle control command, which can improve the security of cross-terminal interaction.

[0097] Figure 4 A flowchart illustrating another voice-based remote vehicle control method provided in this application embodiment is shown below. Figure 4 As shown, the voice-based remote vehicle control method of this application includes, but is not limited to, the following steps: S401 monitors the information sent by the digital human on any of the multiple terminals.

[0098] It should be noted that the execution entity of the voice-based remote vehicle control method provided in this application embodiment is a cloud server. Optionally, the cloud server includes, but is not limited to, a network server, an application server, or a server of a distributed system, or a server combined with blockchain, etc. This application embodiment does not impose specific limitations.

[0099] In some embodiments, the cloud server can listen to the information sent by the digital human of any of the multiple terminals through its communication interface with multiple terminals, thereby listening to whether the information sent by the digital human of the multiple terminals is a vehicle control command, or a vehicle control voice information and / or text information.

[0100] S402, in response to the detected vehicle control command, forwards the vehicle control command to the vehicle control system.

[0101] In some embodiments, if the information monitored by the cloud server is a vehicle control command, the vehicle control command can be forwarded to the vehicle. In order to enable the vehicle to be controlled based on the vehicle control command, the vehicle control command can be directly forwarded to the vehicle's control system.

[0102] In some embodiments, the response is to detect vehicle control voice information and / or text information sent by a digital human. The text information is the text information resulting from voice-to-text processing of the vehicle control voice information.

[0103] In some embodiments, by performing intent recognition on the vehicle control voice information and / or text information, the target device, target operation type, and target operation parameters that need to be controlled in the vehicle are extracted, and a vehicle control command is generated based on the target device, target operation type, and target operation parameters.

[0104] Optionally, the specific implementation methods for extracting the target equipment, target operation type, and target operation parameters that need to be controlled in the vehicle can be found in the above embodiments, and will not be repeated here.

[0105] Optionally, the specific implementation method for generating vehicle control commands based on the target device, target operation type, and target operation parameters can be found in the above embodiments, and will not be repeated here.

[0106] It should be noted that the vehicle control voice information and / or text information received by the cloud server is abstract voice information and / or text information issued by the user. For example, if the terminal's local intent recognition model cannot accurately extract the target device, target operation type, and target operation parameters that need to be controlled in the vehicle from the above information, then the vehicle control voice information and / or text information will be sent to the cloud server for processing.

[0107] In some embodiments, the cloud server can invoke a large-scale semantic understanding model to perform semantic understanding on the vehicle control voice information and / or text information, thereby extracting the user's intent and generating corresponding vehicle control commands.

[0108] For example, if "It's too hot today" means that the user wants to cool down the interior of the vehicle, then the target device to be controlled in the vehicle is the air conditioner, the target operation type is to turn on the air conditioner, and the target operation parameter can be the configured initial temperature, such as 26 degrees.

[0109] In some embodiments, to improve the security of cross-device interaction, the cloud server can also verify the identity of the terminal before forwarding the vehicle control command to the vehicle control system. The identity verification result of the terminal containing the digital human is obtained by verifying the terminal's identity.

[0110] Optionally, the terminal's identity can be verified based on its identification information. This verification can check whether the terminal's identification information exists in an identification information database, which includes identification information of terminals permitted to interact with the cloud server.

[0111] Optionally, if the terminal exists in the identification information database, it can be determined that the terminal has passed the identity verification; if it does not exist in the identification information database, it can be determined that the terminal has failed the identity verification.

[0112] In some embodiments, regardless of whether the terminal passes identity verification, an identity verification result can be generated. In response to the identity verification result indicating that the terminal has passed identity verification, the vehicle control command is forwarded to the vehicle control system.

[0113] In some embodiments, the cloud server can also verify the terminal's permissions to determine whether the terminal can remotely control the vehicle. Optionally, the permission level of the terminal where the awakened digital human is located can be obtained; if the permission level is greater than a set level, it is determined that the terminal can remotely control the vehicle.

[0114] S403, a digital human that receives the vehicle control execution result of the vehicle control command and feeds back the vehicle control execution result to at least one of the multiple terminals.

[0115] In some embodiments, after the cloud server forwards the vehicle control command to the vehicle control system, it can receive the vehicle control execution result of the command. The vehicle control execution result can be received through the communication interface between the cloud server and the vehicle control system.

[0116] In some embodiments, since multiple terminals can communicate with the cloud server, all terminals can receive the vehicle control execution results sent by the cloud server. To ensure that users can receive the digital human's broadcast of the vehicle control execution results, and to avoid all terminals' digital humans broadcasting vehicle control execution results simultaneously, thus avoiding resource waste.

[0117] In this embodiment of the application, the digital person of at least one terminal performing the broadcast can be determined by the cloud server. Optionally, the digital person of at least one terminal performing the broadcast can be determined based on the location information of multiple terminals.

[0118] In some embodiments, by sending location reporting requests to multiple terminals, the system receives the respective location information sent by the multiple terminals and determines the digital human of at least one terminal to broadcast based on the location information.

[0119] For example, if multiple terminals, including mobile phones, smart home devices, and smartwatches, have different location information than the smart home devices and smartwatches, but the smartwatches have the same location information as the smart home devices, then the mobile phone can be selected as a digital human terminal for broadcasting.

[0120] In some embodiments, a selection instruction can be generated based on a digital human at at least one terminal and sent to at least one terminal. The selection instruction may carry a vehicle control execution result, so that after receiving the selection instruction, at least one terminal can determine the vehicle control execution result by parsing the selection instruction.

[0121] The voice-based remote vehicle control method provided in this application involves listening to information sent by a digital human on any of multiple terminals. Upon detecting a vehicle control command, the command is forwarded to the vehicle control system. This allows the system to receive the vehicle's execution result and feed it back to the digital human on at least one of the multiple terminals. Through natural language interaction with the digital human, vehicle control via voice is achieved, lowering the operational barrier for remote vehicle control. Furthermore, after issuing voice control information, the digital human can broadcast the execution result, providing timely feedback on remote vehicle control.

[0122] Figure 5 A flowchart illustrating another voice-based remote vehicle control method provided in this application embodiment is shown below. Figure 5 As shown, the voice-based remote vehicle control method of this application includes, but is not limited to, the following steps: S501 receives vehicle control commands sent by the cloud server.

[0123] It should be noted that the executing entity of the voice-based remote vehicle control method provided in this application embodiment is a vehicle. The vehicle can be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicle. The vehicle can be an intelligent driving vehicle, a semi-intelligent driving vehicle, or a non-intelligent driving vehicle. This application embodiment does not impose specific limitations.

[0124] In some embodiments, vehicle control commands sent by the cloud server can be received through a communication interface that communicates with the cloud server.

[0125] S502 calls the vehicle control server corresponding to the vehicle control command.

[0126] The S503 executes vehicle control commands through the vehicle control server and feeds back the vehicle control command execution results to the cloud server.

[0127] In some embodiments, the vehicle control command can be parsed to determine the target device in the vehicle that needs to be controlled, and the vehicle control server where the target device is located can be determined as the vehicle control server corresponding to the vehicle control command.

[0128] The vehicle control server includes a body control server, a cockpit control server, and a media control server. The body control server can control the doors, windows, trunk, etc.; the cockpit control server can control the air conditioning, seats, car refrigerator, etc.; and the media control server can control music, navigation, screens, etc.

[0129] In some embodiments, the vehicle control server corresponding to the vehicle control command can be invoked through the service-oriented architecture (SOA) of the vehicle control server.

[0130] In some embodiments, by parsing the vehicle control command, the target device to be controlled, the target operation type, and the target operation parameters in the vehicle are obtained. Then, the vehicle control system calls the vehicle control server corresponding to the target device to execute the target operation type according to the target operation parameters, thereby executing the vehicle control command.

[0131] In other words, the vehicle control server can enable the target device to execute the target operation type according to the target operation parameters, thereby realizing the execution of vehicle control commands.

[0132] In some embodiments, after the vehicle control command is executed, a vehicle control execution result can be generated based on the vehicle's status information, and the vehicle control execution result can be fed back to the cloud server, so that the cloud server can send the vehicle control execution result to the terminal.

[0133] The voice-based remote vehicle control method provided in this application receives vehicle control commands sent by a cloud server and calls the corresponding vehicle control server. The vehicle control server then executes the commands and feeds back the execution results to the cloud server. This enables natural language interaction with a digital human, allowing for vehicle control via voice, thus lowering the operational threshold for remote vehicle control.

[0134] Figure 6This is an architecture diagram of the voice-based remote vehicle control method provided in the embodiments of this application. Figure 6 The various terminals include: mobile phones, in-vehicle electronic devices, smartwatches, and home devices. These terminals can access the same digital human and cloud server through a cross-terminal access layer.

[0135] When a digital human on any of multiple terminals receives a user's voice command for vehicle control, it can perform intent recognition on the terminal itself to generate corresponding vehicle control commands. Alternatively, a cloud server can invoke a natural language understanding engine to understand the intent of the voice command and obtain the vehicle control commands.

[0136] Furthermore, the cloud server can send vehicle control commands to the vehicle control system. After receiving the vehicle control commands, the vehicle control system can parse them to extract the target device to be controlled, the target operation type, and the target operation parameters. Then, through the SOA interface of the vehicle control server, it can call the vehicle control server corresponding to the target device to control the target device to execute the target operation type according to the target operation parameters, thereby realizing the execution of the vehicle control commands.

[0137] After executing the vehicle control command, the corresponding vehicle control execution result can be generated and transmitted back to the digital human, which will then broadcast the result.

[0138] Corresponding to the voice-based remote vehicle control methods proposed in the above embodiments, one embodiment of this application also proposes a voice-based remote vehicle control device. Since the voice-based remote vehicle control device proposed in this application corresponds to the voice-based remote vehicle control methods proposed in the above embodiments, the implementation methods of the above-mentioned voice-based remote vehicle control methods are also applicable to the voice-based remote vehicle control device proposed in this application, and will not be described in detail in the following embodiments.

[0139] Figure 7 This is a schematic diagram of the structure of a voice-based remote vehicle control device provided in an embodiment of this application.

[0140] like Figure 7 As shown, the voice-based remote vehicle control device 700 includes: The first receiving module 701 is configured to receive the user's vehicle control voice information through the awakened digital human of any of the multiple terminals in response to the digital human being being woken up. The digital humans of the multiple terminals have the same interaction interface. The intent recognition module 702 is used to perform intent recognition on the vehicle control voice information through the awakened digital human, obtain the user's vehicle control intent, and generate structured vehicle control commands based on the vehicle control intent; The sending module 703 is used to send the vehicle control command to the cloud server through the awakened digital human; The second receiving module 704 is used to receive the vehicle control execution result sent by the cloud server through the digital human of at least one of the plurality of terminals; The broadcasting module 705 is used to broadcast the vehicle control execution result through the digital human of the at least one terminal.

[0141] In one possible implementation of this application embodiment, the intent recognition module 702 is further configured to: perform speech-to-text processing on the vehicle control voice information to obtain text information corresponding to the vehicle control voice information; perform intent recognition on the text information to extract the target device, target operation type and target operation parameters that need to be controlled in the vehicle; and generate the structured vehicle control command based on the target device, the target operation type and the target operation parameters.

[0142] In one possible implementation of this application embodiment, the intent recognition module 702 is further configured to: in response to the failure to extract at least one of the target device, the target operation type, and the target operation parameters from the text information, forward the text information and / or vehicle control voice information to the cloud server for intent recognition to obtain the vehicle control command.

[0143] In one possible implementation of this application embodiment, the second receiving module 704 is further configured to: receive the identity verification result of the terminal where the awakened digital human is located, sent by the cloud server; and, in response to the identity verification result instructing the terminal to pass the identity verification, receive the vehicle control execution result sent by the cloud server through the digital human of at least one of the plurality of terminals.

[0144] In one possible implementation of this application embodiment, the broadcasting module 705 is further configured to: generate intent feedback information corresponding to the vehicle control intent based on the vehicle control execution result, and broadcast the intent feedback information through the digital human of the at least one terminal; wherein, the intent feedback information includes at least vehicle status information.

[0145] In one possible implementation of this application embodiment, the second receiving module 704 is further configured to: send the location information of each of the plurality of terminals to the cloud server based on the location reporting request sent by the cloud server; wherein the location information is used by the cloud server to determine the digital human of at least one terminal that is broadcasting.

[0146] In the voice-based remote vehicle control device provided in this application embodiment, in response to the wake-up of a digital human on any of multiple terminals, the woken digital human receives the user's vehicle control voice information, performs intent recognition on the voice information to obtain the user's vehicle control intent, and generates structured vehicle control commands based on the intent. The woken digital human sends the vehicle control commands to a cloud server and receives the vehicle control execution results sent by the cloud server, and broadcasts the vehicle control execution results through the digital human on at least one terminal. Therefore, this solution can achieve vehicle control via voice through natural language interaction with the digital human, lowering the operational threshold for remote vehicle control. The digital human on the vehicle end and the terminal end are identical, improving the consistency of cross-terminal interaction. Moreover, after issuing vehicle control voice information, the digital human can also broadcast the vehicle control execution results, achieving timely feedback on remote vehicle control.

[0147] Figure 8 This is a schematic diagram of another voice-based remote vehicle control device provided in an embodiment of this application.

[0148] like Figure 8 As shown, the voice-based remote vehicle control device 800 includes: The listening module 801 is used to listen to the information sent by the digital human on any of the multiple terminals; The forwarding module 802 is used to forward the vehicle control command to the vehicle control system in response to the detected information being a vehicle control command; The processing module 803 is used to receive the vehicle control execution result of the vehicle executing the vehicle control command, and to feed back the vehicle control execution result to at least one of the multiple terminals.

[0149] In one possible implementation of this application embodiment, the forwarding module 802 is further configured to: perform identity verification on the terminal where the digital human is located, and obtain the identity verification result of the terminal; in response to the identity verification result instructing the terminal to pass the identity verification, forward the vehicle control command to the vehicle control system.

[0150] In one possible implementation of this application embodiment, the forwarding module 802 is further configured to: respond to the detection of vehicle control voice information and / or text information sent by the digital human; perform intent recognition on the vehicle control voice information and / or text information to extract the target device, target operation type and target operation parameters that need to be controlled in the vehicle; and generate the vehicle control command based on the target device, the target operation type and the target operation parameters.

[0151] In one possible implementation of this application embodiment, the processing module 803 is further configured to: send a location reporting request to the plurality of terminals to receive the respective location information sent by the plurality of terminals; determine the digital human of at least one terminal to be broadcast based on the location information; generate a selection instruction based on the digital human of the at least one terminal, and send the selection instruction to the at least one terminal.

[0152] The voice-based remote vehicle control device provided in this application embodiment listens to information sent by a digital human on any of multiple terminals. In response to a detected vehicle control command, the command is forwarded to the vehicle control system. This allows the device to receive the vehicle's execution result and feed it back to the digital human on at least one of the multiple terminals. Through natural language interaction with the digital human, vehicle control via voice is achieved, lowering the operational barrier for remote vehicle control. Furthermore, after issuing voice control information, the digital human can broadcast the execution result, providing timely feedback on remote vehicle control.

[0153] Figure 9 This is a schematic diagram of another voice-based remote vehicle control device provided in an embodiment of this application.

[0154] like Figure 9 As shown, the voice-based remote vehicle control device 800 includes: The receiving module 901 is used to receive vehicle control commands sent by the cloud server; Module 902 is used to invoke the vehicle control server corresponding to the vehicle control command; The execution module 903 is used to execute the vehicle control command through the vehicle control server and feed back the vehicle control command execution result to the cloud server.

[0155] In one possible implementation of this application, the execution module 903 is further configured to: parse the vehicle control command to obtain the target device to be controlled in the vehicle, the target operation type, and the target operation parameters; and call the vehicle control server corresponding to the target device through the vehicle control system to execute the target operation type on the target device according to the target operation parameters, so as to execute the vehicle control command.

[0156] The voice-based remote vehicle control device provided in this application receives vehicle control commands sent by a cloud server and calls the corresponding vehicle control server. The vehicle control server then executes the commands and feeds back the execution results to the cloud server. This enables natural language interaction with a digital human, allowing for vehicle control via voice, thus lowering the operational threshold for remote vehicle control.

[0157] It should be noted that the foregoing explanation of the embodiment of the voice-based remote vehicle control method also applies to the voice-based remote vehicle control device of this embodiment, and will not be repeated here.

[0158] To implement the above embodiments, this application also proposes an electronic device, including: a processor and a memory communicatively connected to the processor; the memory stores computer execution instructions; the processor executes the computer execution instructions stored in the memory to implement the method provided in the foregoing embodiments.

[0159] To implement the above embodiments, this application also proposes a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, are used to implement the methods provided in the foregoing embodiments.

[0160] To implement the above embodiments, this application also proposes a computer program product, including a computer program that, when executed by a processor, implements the methods provided in the foregoing embodiments.

[0161] The collection, storage, use, processing, transmission, provision, and application of user personal information involved in this application all comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0162] It should be noted that personal information collected from users should be used for legitimate and reasonable purposes and should not be shared or sold outside of these legitimate uses. Furthermore, such collection / sharing should only be conducted after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign an agreement / authorization that includes authorization of relevant user information before the user uses the function. In addition, any necessary steps must be taken to protect and safeguard access to such personal information data and ensure that others with access to personal information data comply with their privacy policies and procedures.

[0163] This application is intended to provide an implementation scheme for users to selectively prevent the use or access to their personal information data. Specifically, this application is intended to provide hardware and / or software to prevent or block access to such personal information data. Once personal information data is no longer needed, risks can be minimized by restricting data collection and deleting data. Furthermore, where applicable, such personal information is de-identified to protect user privacy.

[0164] In the foregoing descriptions of the embodiments, the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of this application. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0165] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this application, "multiple" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0166] Any process or method described in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing custom logic functions or processes, and the scope of the preferred embodiments of this application includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as should be understood by those skilled in the art to which embodiments of this application pertain.

[0167] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-included system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include: an electrical connection having one or more wires (electronic device), a portable computer disk drive (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and editable read-only memory (EPROM or flash memory), fiber optic devices, and portable optical disc read-only memory (CDROM). Alternatively, the computer-readable medium may be paper or other suitable media on which the program can be printed, since the program can be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, interpreting, or otherwise processing as necessary, and then stored in a computer memory.

[0168] It should be understood that various parts of this application can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any of the following techniques known in the art, or a combination thereof: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0169] Those skilled in the art will understand that all or part of the steps of the methods in the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, the program includes one or a combination of the steps of the method embodiments.

[0170] Furthermore, the functional units in the various embodiments of this application can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0171] The storage medium mentioned above can be a read-only memory, a disk, or an optical disk, etc. Although embodiments of this application have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting this application. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of this application.

Claims

1. A voice-based remote vehicle control method, characterized in that, The method includes: In response to the digital human being being woken up on any of the multiple terminals, the woken digital human receives the user's vehicle control voice information, wherein the digital humans on the multiple terminals have the same interaction interface; The awakened digital human performs intent recognition on the vehicle control voice information to obtain the user's vehicle control intent, and generates structured vehicle control commands based on the vehicle control intent. The awakened digital human sends the vehicle control command to the cloud server; The digital human, through at least one of the multiple terminals, receives the vehicle control execution result sent by the cloud server; The digital human at at least one terminal broadcasts the results of the vehicle control operation. Before the digital human, through at least one of the plurality of terminals, receives the vehicle control execution result sent by the cloud server, the process further includes: Based on the location reporting request sent by the cloud server, the location information of each of the multiple terminals is sent to the cloud server; wherein, the location information is used by the cloud server to determine the digital persona of at least one terminal to make a broadcast, generate a selection instruction based on the digital persona of at least one terminal, and send the selection instruction to at least one terminal, wherein the selection instruction carries the vehicle control execution result.

2. The method according to claim 1, characterized in that, The step of recognizing the user's intent to control the vehicle through the awakened digital human, obtaining the user's vehicle control intent, and generating structured vehicle control commands based on the vehicle control intent includes: The vehicle control voice information is processed into text to obtain the corresponding text information. The text information is subjected to intent recognition to extract the target device, target operation type and target operation parameters that need to be controlled in the vehicle. The structured vehicle control command is generated based on the target device, the target operation type, and the target operation parameters.

3. The method according to claim 2, characterized in that, The method further includes: In response to the failure to extract at least one of the target device, the target operation type, and the target operation parameters from the text information, the text information and / or vehicle control voice information are forwarded to the cloud server for intent recognition in order to obtain the vehicle control command.

4. The method according to claim 1, characterized in that, Before the digital human, through at least one of the plurality of terminals, receives the vehicle control execution result sent by the cloud server, the process includes: Receive the identity verification result of the terminal where the awakened digital human is located, sent by the cloud server; In response to the identity verification result indicating that the terminal has passed the identity verification, the digital human of at least one of the plurality of terminals receives the vehicle control execution result sent by the cloud server.

5. The method according to any one of claims 1-4, characterized in that, The process of broadcasting the vehicle control execution result through the digital human at least one terminal includes: Based on the vehicle control execution result, intent feedback information corresponding to the vehicle control intent is generated, and the intent feedback information is broadcast through the digital human of the at least one terminal; wherein, the intent feedback information includes at least the vehicle status information.

6. A voice-based remote vehicle control method, characterized in that, The method includes: Listen to the information sent by the digital human on any of multiple terminals; In response to the detected information being a vehicle control command, the vehicle control command is forwarded to the vehicle control system; A digital human that receives the vehicle control execution result of the vehicle control command and feeds back the vehicle control execution result to at least one of the plurality of terminals. Before the digital human that receives the vehicle control execution result of the vehicle executing the vehicle control command and feeds back the vehicle control execution result to at least one of the plurality of terminals, it further includes: Send location reporting requests to the multiple terminals to receive their respective location information from the multiple terminals; Based on the location information, at least one digital human from a terminal is identified to make the broadcast; The digital human generates a selection instruction based on the at least one terminal and sends the selection instruction to the at least one terminal, wherein the selection instruction carries the result of vehicle control execution.

7. The method according to claim 6, characterized in that, Before forwarding the vehicle control command to the vehicle control system, the following steps are included: The identity of the terminal where the digital human is located is verified, and the identity verification result of the terminal is obtained; In response to the identity verification result indicating that the terminal has passed the identity verification, the vehicle control command is forwarded to the vehicle control system.

8. The method according to claim 6, characterized in that, The method further includes: In response to the detected information being vehicle control voice information and / or text information sent by the digital human; The intent is recognized from the vehicle control voice information and / or text information to extract the target device, target operation type and target operation parameters that need to be controlled in the vehicle. The vehicle control command is generated based on the target device, the target operation type, and the target operation parameters.

9. A voice-based remote vehicle control method, characterized in that, The method includes: Receive vehicle control commands sent by the cloud server; Call the vehicle control server corresponding to the vehicle control command; The vehicle control server executes the vehicle control command and feeds back the vehicle control command execution result to the cloud server. The cloud server then feeds back the vehicle control execution result to a digital human at least one of multiple terminals, including: Send location reporting requests to the multiple terminals to receive their respective location information from the multiple terminals; Based on the location information, at least one digital human from a terminal is identified to make the broadcast; The digital human generates a selection instruction based on the at least one terminal and sends the selection instruction to the at least one terminal, wherein the selection instruction carries the result of vehicle control execution.

10. The method according to claim 9, characterized in that, The execution of the vehicle control command through the vehicle control server includes: The vehicle control command is parsed to obtain the target equipment, target operation type, and target operation parameters that need to be controlled in the vehicle; The vehicle control system calls the vehicle control server corresponding to the target device to execute the target operation type according to the target operation parameters, thereby executing the vehicle control command.

11. A voice-based remote vehicle control device, characterized in that, The device includes: The first receiving module is configured to receive the user's vehicle control voice information through the awakened digital human of any of the multiple terminals in response to the digital human being being woken up. The digital humans of the multiple terminals have the same interaction interface. The intent recognition module is used to perform intent recognition on the vehicle control voice information through the awakened digital human, obtain the user's vehicle control intent, and generate structured vehicle control commands based on the vehicle control intent; The sending module is used to send the vehicle control command to the cloud server through the awakened digital human; The second receiving module is used to receive the vehicle control execution result sent by the cloud server through the digital human of at least one of the plurality of terminals; The broadcasting module is used to broadcast the vehicle control execution results through the digital human of the at least one terminal; The second receiving module is further configured to send the location information of each of the plurality of terminals to the cloud server based on the location reporting request sent by the cloud server; wherein the location information is used by the cloud server to determine the digital person of at least one terminal to make a broadcast, generate a selection instruction based on the digital person of at least one terminal, and send the selection instruction to at least one terminal, wherein the selection instruction carries the vehicle control execution result.

12. A voice-based remote vehicle control device, characterized in that, The device includes: The monitoring module is used to monitor the information sent by the digital human on any of the multiple terminals. The forwarding module is used to forward the vehicle control command to the vehicle control system in response to the detected information being a vehicle control command; The processing module is used to receive the vehicle control execution result of the vehicle executing the vehicle control command, and to feed back the vehicle control execution result to at least one of the multiple terminals of the digital human. The processing module is used to send location reporting requests to the multiple terminals, and to receive the location information sent by the multiple terminals respectively. Based on the location information, at least one digital human from a terminal is identified to make the broadcast; The digital human generates a selection instruction based on the at least one terminal and sends the selection instruction to the at least one terminal, wherein the selection instruction carries the result of vehicle control execution.

13. A voice-based remote vehicle control device, characterized in that, The device includes: The receiving module is used to receive vehicle control commands sent by the cloud server; The calling module is used to call the vehicle control server corresponding to the vehicle control command; An execution module is configured to execute the vehicle control command via the vehicle control server and feed back the vehicle control command execution result to the cloud server; the cloud server feeds back the vehicle control execution result to a digital human at least one of multiple terminals, wherein the execution module includes: Send location reporting requests to the multiple terminals to receive their respective location information from the multiple terminals; Based on the location information, at least one digital human from a terminal is identified to make the broadcast; The digital human generates a selection instruction based on the at least one terminal and sends the selection instruction to the at least one terminal, wherein the selection instruction carries the result of vehicle control execution.

14. An electronic device, characterized in that, include: A processor, and a memory communicatively connected to the processor; The memory stores computer-executed instructions; The processor executes computer execution instructions stored in the memory to implement the method as described in any one of claims 1-10.

15. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by a processor, are used to implement the method as described in any one of claims 1-10.

16. A computer program product, characterized in that, Includes a computer program that, when executed by a processor, implements the method of any one of claims 1-10.

Images