Target vehicle control method and device, medium and electronic equipment

Abstract

The invention discloses a target vehicle control method and device, a medium and electronic equipment, and the method comprises the steps: receiving a voice control instruction of a target user; a target operation library of the target user is obtained, the target operation library comprises a user-defined operation library and a preset operation library, the user-defined operation library comprises at least one set of user-defined instructions and user-defined operations with the corresponding relation, and the preset operation library comprises at least one set of preset instructions and preset operations with the corresponding relation; determining a first instruction matched with the voice control instruction and a first operation corresponding to the first instruction from a user-defined operation library; controlling the target vehicle to execute the first operation; if the first instruction does not exist in the user-defined operation library, determining a second instruction matched with the voice control instruction and a second operation corresponding to the second instruction from a preset operation library; and controlling the target vehicle to execute the second operation. Through the technical scheme provided by the invention, the control efficiency of the target vehicle can be improved.

Description

Technical Field

[0001] The present application belongs to the field of vehicle control technology, and in particular relates to a control method, device, medium and electronic equipment for a target vehicle. Background Art

[0002] Many vehicles now have voice control capabilities, but in practice, these controls often rely on a fixed set of pre-set commands from the car manufacturer. However, when these pre-set commands differ from the driver's language preferences, the corresponding actions often fail to trigger, reducing vehicle control efficiency.

[0003] Based on this, the low control efficiency of the target vehicle is a technical problem that needs to be solved urgently. Summary of the Invention

[0004] The embodiments of the present application provide a method, device, medium, and electronic device for controlling a target vehicle, thereby improving the control efficiency of the target vehicle at least to a certain extent.

[0005] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by practice of the present application.

[0006] According to a first aspect of an embodiment of the present application, a method for controlling a target vehicle is provided, the method comprising:

[0007] Receive voice control instructions from the target user;

[0008] Obtaining a target operation library of the target user, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of custom instructions and custom operations with corresponding relationships, and the preset operation library includes at least one set of preset instructions and preset operations with corresponding relationships;

[0009] Determining a first instruction matching the voice control instruction and a first operation corresponding to the first instruction from the custom operation library; and controlling the target vehicle to perform the first operation;

[0010] If the first instruction does not exist in the custom operation library, a second instruction matching the voice control instruction and a second operation corresponding to the second instruction are determined from the preset operation library; and the target vehicle is controlled to perform the second operation.

[0011] In some embodiments of the present application, based on the aforementioned scheme, determining the first instruction that matches the voice control instruction and the first operation corresponding to the first instruction from the custom operation library includes: matching the voice control instruction with each of the custom instructions in the custom operation library; determining the custom instruction that matches the voice control instruction as the first instruction, and determining the custom operation corresponding to the first instruction as the first operation; if the custom instruction that matches the voice control instruction does not exist in the custom operation library, determining that the first instruction does not exist in the custom operation library.

[0012] In some embodiments of the present application, based on the aforementioned scheme, matching the voice control instruction with each of the custom instructions in the custom operation library includes: extracting a first voice feature of the voice control instruction; matching the first voice feature with each of the custom instructions in the custom operation library, wherein the custom instruction is used to characterize the voice feature of the corresponding custom operation.

[0013] In some embodiments of the present application, based on the aforementioned scheme, before determining the custom instruction that matches the voice control instruction as the first instruction, the method also includes: obtaining an add instruction triggered by the target user, wherein the add instruction carries the instruction voice and at least one third operation included in the first operation; extracting the second voice feature of the instruction voice; if the first operation includes a single third operation, constructing the first instruction and the first operation with a corresponding relationship based on the second voice feature and the third operation; if the first operation includes multiple third operations, constructing the first instruction and the first operation with a corresponding relationship based on the second voice feature and each third operation; and adding the first instruction and the first operation with a corresponding relationship to the custom operation library.

[0014] In some embodiments of the present application, based on the aforementioned scheme, a microphone array and a vehicle touch screen are deployed on the target vehicle, and obtaining the add instruction triggered by the target user includes: obtaining the instruction voice issued by the target user through the microphone array; obtaining at least one of the third operations clicked by the target user through the vehicle touch screen; if at least one of the third operations and the instruction voice are received at the same time, it is determined that the target user has triggered the add instruction.

[0015] In some embodiments of the present application, based on the aforementioned scheme, the constructing of the first instruction and the first operation having a corresponding relationship based on the second voice feature and the third operation includes: determining a fourth instruction matching the second voice feature from the preset operation library; copying the fourth instruction and the fourth operation corresponding to the fourth instruction from the preset operation library; using the third operation to update the fourth operation to obtain the fourth instruction and the third operation having a corresponding relationship; and determining the fourth instruction and the third operation having a corresponding relationship as the first instruction and the first operation having a corresponding relationship.

[0016] In some embodiments of the present application, based on the aforementioned scheme, the constructing of the first instruction and the first operation having a corresponding relationship based on the second voice feature and each of the third operations includes: determining a fifth instruction matching the second voice feature from the preset operation library; copying the fifth instruction and the fifth operation corresponding to the fifth instruction from the preset operation library; using each of the third operations to construct a combined operation; using the combined operation to update the fifth operation to obtain the fifth instruction and the combined operation having a corresponding relationship; and determining the fifth instruction and the combined operation having a corresponding relationship as the first instruction and the first operation having a corresponding relationship.

[0017] According to a second aspect of an embodiment of the present application, a control device for a target vehicle is provided, the device comprising:

[0018] A receiving module, configured to receive a target user's voice control command;

[0019] A first acquisition module is configured to acquire a target operation library of the target user, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of corresponding custom instructions and custom operations, and the preset operation library includes at least one set of corresponding preset instructions and preset operations;

[0020] a first determining module, configured to determine, from the custom operation library, a first instruction matching the voice control instruction and a first operation corresponding to the first instruction; and a first controlling module, configured to control the target vehicle to perform the first operation;

[0021] The second determination module is used to determine a second instruction matching the voice control instruction and a second operation corresponding to the second instruction from the preset operation library if the first instruction does not exist in the custom operation library; the second control module is used to control the target vehicle to perform the second operation.

[0022] According to a third aspect of an embodiment of the present application, a computer-readable storage medium is provided, in which at least one computer program instruction is stored. The at least one computer program instruction is loaded and executed by a processor to implement the operations performed by the method described in any one of the first aspects above.

[0023] According to a fourth aspect of an embodiment of the present application, an electronic device is provided, comprising one or more processors and one or more memories, wherein at least one computer program instruction is stored in the one or more memories, and the at least one computer program instruction is loaded and executed by the one or more processors to implement the method described in any embodiment of the first aspect above.

[0024] In the present application, a target user's voice control instruction is received; a target operation library of the target user is obtained, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of custom instructions and custom operations with corresponding relationships, and the preset operation library includes at least one set of preset instructions and preset operations with corresponding relationships; a first instruction matching the voice control instruction and a first operation corresponding to the first instruction are determined from the custom operation library; a target vehicle is controlled to perform the first operation; if the first instruction does not exist in the custom operation library, a second instruction matching the voice control instruction and a second operation corresponding to the second instruction are determined from the preset operation library; and the target vehicle is controlled to perform the second operation. In other words, the custom operation library that conforms to the target user's language habits is first used to respond to the voice control instruction, thereby improving the response efficiency of the voice control instruction and thus improving the control efficiency of the vehicle.

[0025] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The accompanying drawings are incorporated into and constitute a part of the specification, illustrating embodiments consistent with the present application and, together with the specification, explaining the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can derive other drawings based on these drawings without inventive effort. In the drawings:

[0027] Figure 1 A flow chart showing a method for controlling a target vehicle in an embodiment of the present application is shown;

[0028] Figure 2 A schematic diagram of a vehicle split-screen interface in an embodiment of the present application is shown;

[0029] Figure 3A timing diagram showing a control process of a target vehicle in an embodiment of the present application is shown;

[0030] Figure 4 A block diagram of a control device for a target vehicle in an embodiment of the present application is shown;

[0031] Figure 5 A schematic structural diagram of an electronic device in an embodiment of the present application is shown. DETAILED DESCRIPTION

[0032] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0033] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner.In the following description, many specific details are provided so as to provide a full understanding of the embodiments of the present application. However, it will be appreciated by those skilled in the art that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps etc. can be adopted. In other cases, known methods, devices, implementations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0034] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically separate entities. That is, these functional entities may be implemented in software, in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0035] The flowcharts shown in the accompanying drawings are for illustrative purposes only and do not necessarily include all contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may be decomposed, while others may be combined or partially combined. Therefore, the actual execution order may vary depending on the actual situation.

[0036] It should be noted that the term "plurality" as used herein refers to two or more. The terms "first," "second," and the like in the specification and claims of this application and the accompanying drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than that illustrated or described.

[0037] Figure 1 A flow chart showing a method for controlling a target vehicle in an embodiment of the present application is shown. The method for controlling a target vehicle can be executed by a device having a computing and processing function in the target vehicle. Figure 1 As shown, the control method of the target vehicle includes:

[0038] Step 101: Receive a voice control command from a target user;

[0039] Step 102: Acquire a target operation library of the target user, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of corresponding custom instructions and custom operations, and the preset operation library includes at least one set of corresponding preset instructions and preset operations;

[0040] Step 103-1: Determine a first instruction matching the voice control instruction and a first operation corresponding to the first instruction from the custom operation library;

[0041] Step 103-2: Control the target vehicle to perform the first operation;

[0042] Step 104-1: If the first instruction does not exist in the custom operation library, determine a second instruction matching the voice control instruction and a second operation corresponding to the second instruction from the preset operation library;

[0043] Step 104 - 2 : Control the target vehicle to perform the second operation.

[0044] Through the above steps, a target user's voice control instruction is received; a target operation library of the target user is obtained, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of corresponding custom instructions and custom operations, and the preset operation library includes at least one set of corresponding preset instructions and preset operations; a first instruction matching the voice control instruction and a first operation corresponding to the first instruction are determined from the custom operation library; a target vehicle is controlled to perform the first operation; if the first instruction does not exist in the custom operation library, a second instruction matching the voice control instruction and a second operation corresponding to the second instruction are determined from the preset operation library; and the target vehicle is controlled to perform the second operation. In other words, the custom operation library that matches the target user's language habits is first used to respond to the voice control instruction, thereby improving the response efficiency of the voice control instruction and thus improving the control efficiency of the vehicle.

[0045] In this process, the voice control priority response mechanism prioritizes matching user-defined commands, enhancing the personalized experience. A pre-built operation library provides a standardized backup solution, ensuring the reliability of basic functions. By establishing a dual-library collaborative architecture, both personalized and standardized needs can be met.

[0046] In the embodiment provided in step 101, the target user is a vehicle owner or user using the voice control function. The target user's identity can be identified through, but is not limited to, voiceprints, account binding, and other methods, and a function for responding to voice control commands can be provided. For example, through voiceprint recognition, the target user with control rights for the target vehicle is identified and their voice control commands are responded to. Alternatively, the target user can be identified based on the digital key (Bluetooth key) used to unlock the target vehicle. Alternatively, the target user can be identified based on the target vehicle's login ID (Identity Document), etc.

[0047] Optionally, in this embodiment, the voice control instructions are commands input by the target user via voice, used to control the vehicle to perform specific operations (e.g., turning on the air conditioner, etc.). The voice control instructions may be captured, but are not limited to, by a microphone array deployed on the target vehicle. The voice control instructions may be standard commands preset by the vehicle manufacturer or personalized commands that conform to the user's language habits.

[0048] Optionally, in this embodiment, the voice control command issued by the target user may include, but is not limited to: the target user issuing a standard voice control command "turn on the air conditioner" or the target user issuing a custom command "add some air" that conforms to their language habits.

[0049] In the embodiment provided in step 102, the target operation library is a database storing all executable instructions and operations. According to the voice instruction, the custom operation library is matched first, and if no match is found, the preset operation library is searched.

[0050] Optionally, in this embodiment, the custom operation library includes commands and operations obtained by the target user combining or modifying preset commands and preset operations in the preset operation library. For example, if the preset operation library includes the preset command and preset operation "open trunk", and the target user modifies the preset command to the custom command "open luggage door", the corresponding custom operation remains "open trunk"; or, if the target user combines the preset commands "open trunk" and "close trunk" into the custom command "open luggage door", the corresponding custom operation becomes "open trunk + close trunk".

[0051] Optionally, in this embodiment, the custom operation library is associated with the user account or voiceprint of the target user to ensure that the personalization is only effective for the target user. In other words, different target users can have their own corresponding custom operation libraries.

[0052] For example, in a target vehicle with user A and user B in a custom operation library linked to a voiceprint, when user A issues a voice control command A, the corresponding custom operation library A is obtained by recognizing user A's voiceprint. If the corresponding custom operation library A is obtained, the response voice command A is first matched from custom operation library A. If no match is found in custom operation library A, the response voice command A is matched from the pre-installed operation library deployed in the target vehicle. If no match is found in custom operation library A, the response voice command A is directly matched from the pre-installed operation library deployed in the target vehicle. When user B issues a voice control command B (user B's voiceprint is stored in the target vehicle), the above process is still used to achieve a response voice control command B.

[0053] For example, in a scenario where a custom operation library is associated with a user account, and the target vehicle includes user A and user B, and user B is logged into the target vehicle through user account B, custom operation library B associated with user account B is loaded into the target vehicle during the login process. When user B issues a voice control command B, the system first matches the response to the custom operation library B. If no response is found in the custom operation library B, the system then matches the response to the pre-installed operation library deployed in the target vehicle. When user A issues a voice control command A, since custom operation library A is not loaded in the target vehicle, it can be assumed that user A can only match the response to the pre-installed operation library deployed in the target vehicle, or that user A does not have control authority and cannot respond.

[0054] Optionally, in this embodiment, when the target vehicle logs in a new user (or registers the voiceprint of a new user), the target vehicle will push the preset operation library to the new user and will not display the original user's custom operation library, ensuring that the old user's usage habits will not affect the new user. At the same time, the new user can also personalize the preset operation library to obtain its corresponding custom operation library.

[0055] Optionally, in this embodiment, the preset operation library is a set of standardized instructions and operations pre-set by the car manufacturer.

[0056] Optionally, in this embodiment, the preset instructions are common voice instructions defined by the car manufacturer, such as: open the trunk, turn on the air conditioner, open the door, etc. The preset operations are standardized vehicle actions corresponding to the preset instructions.

[0057] Optionally, in this embodiment, the above-mentioned custom instructions are personalized voice instructions recorded by the user through the recording function, which contain unique voice features (such as: timbre, wording, etc.). For example: the user sets the custom instruction "turn on the air conditioner" and the corresponding custom operation is "adjust the air conditioner to 20 degrees + maximum wind volume".

[0058] Optionally, in this embodiment, the custom operation is a single or combined vehicle operation specified by the user and bound to a custom command. Single operations may include, but are not limited to, unlocking the doors and turning on the air conditioner. Combined operations may include, but are not limited to, turning on the air conditioner, closing the windows, and adjusting the temperature, unlocking the doors, and opening the trunk.

[0059] In the embodiment provided in step 103-1, the custom operation library stores at least one set of corresponding custom instructions and custom operations. These custom instructions are personalized voice instructions pre-recorded by the target user in the custom operation library that differ from standard instructions. Therefore, the first instruction can be determined from the custom operation library based on, but not limited to, the voice characteristics of the voice control instruction. Alternatively, the voice control instruction can be converted into instruction text and the first instruction can be determined from the custom operation library.

[0060] In one embodiment of the present application, before the custom instruction that matches the voice control instruction is determined as the first instruction, a first instruction and a first operation with a corresponding relationship can be generated in the following manner, but is not limited to: obtaining an add instruction triggered by the target user, wherein the add instruction carries the instruction voice and at least one third operation included in the first operation; extracting the second voice feature of the instruction voice; if the first operation includes a single third operation, constructing the first instruction and the first operation with a corresponding relationship based on the second voice feature and the third operation; if the first operation includes multiple third operations, constructing the first instruction and the first operation with a corresponding relationship based on the second voice feature and each third operation; and adding the first instruction and the first operation with a corresponding relationship to the custom operation library.

[0061] Optionally, in this embodiment, the above-mentioned voice features can be, but are not limited to, the command text converted from the command voice, or can also be a voice vector extracted based on the command voice, etc. It should be noted that the above-mentioned command text or voice vector based on voice features needs to be consistent when constructing the custom operation library and determining the first instruction based on the voice control instruction. In other words, when the custom instructions in the custom operation library are constructed using voice vectors, it is necessary to match the first instruction from the custom operation library based on the voice vector; when the custom instructions in the custom operation library are constructed using instruction text, it is necessary to match the first instruction from the custom operation library based on the instruction text.

[0062] In one embodiment of the present application, a microphone array and a vehicle touch screen are deployed on the target vehicle, and the add instruction triggered by the target user can be obtained in the following ways, but not limited to: obtaining the instruction voice issued by the target user through the microphone array; obtaining at least one of the third operations clicked by the target user through the vehicle touch screen; if at least one of the third operations and the instruction voice are received at the same time, it is determined that the target user has triggered the add instruction.

[0063] Optionally, in this embodiment, the microphone array is a multi-microphone system installed in the target vehicle for collecting user voice with high precision.

[0064] Optionally, in this embodiment, the vehicle touch screen is a touch screen on the center console of the target vehicle, used for human-computer interaction (e.g., setting voice commands and selecting vehicle functions). The vehicle touch screen provides a voice command management interface for users to add, delete, or modify custom commands. For example, in split-screen mode, the left side displays the voice input interface (including a record button and a command list), and the right side displays vehicle control options (including air conditioning, windows, trunk, etc.).

[0065] Optionally, in this embodiment, the user adds personalized voice commands (i.e., custom commands and custom operations with corresponding relationships) through the vehicle touch screen and microphone array. For example, the user enters the voice command management interface, selects "Add new command", speaks the custom command through the microphone (for example, turn on the air conditioner), and selects the corresponding vehicle custom operation on the touch screen (for example, air conditioning 20℃ + close the window), binds the custom command and the custom operation, and stores them in the custom operation library.

[0066] Optionally, in this embodiment, the third action is a single or multiple vehicle control actions selected by the user when adding a command, which are bound to the custom command. If the third action is a single action, it may include, but is not limited to, "adjust the air conditioner to 20°C." If the third action is a combined action, it may include, but is not limited to, "adjust the air conditioner to 20°C + close the windows."

[0067] In one embodiment of the present application, the first instruction and the first operation having a corresponding relationship can be constructed based on the second voice feature and the third operation in the following manner, but is not limited to: determining a fourth instruction matching the second voice feature from the preset operation library; copying the fourth instruction and the fourth operation corresponding to the fourth instruction from the preset operation library; using the third operation to update the fourth operation to obtain the fourth instruction and the third operation having a corresponding relationship; and determining the fourth instruction and the third operation having a corresponding relationship as the first instruction and the first operation having a corresponding relationship.

[0068] Optionally, in this embodiment, the user accesses the vehicle touchscreen interface and views the corresponding preset commands and preset operations in the preset operation library. The user can delete or modify those that do not meet their needs to obtain the custom operation library they need. For example, taking the preset operation library including the preset command "Open Trunk", the user decides that simply opening the trunk is not enough to meet their needs. Therefore, the user selects the command modification interface on the vehicle touchscreen, clicks the record button, and utters the voice command "Open Tailgate". The custom command "Open Tailgate" is then associated with the custom operation "Open Trunk" and added to the custom operation library.

[0069] Similarly, the user can associate the preset operation of "open the trunk" with multiple custom commands such as "open the back door" and "open the rear compartment" through the above process.

[0070] It should be noted that, in the above-mentioned process of modifying the preset instructions and preset operations with corresponding relationships in the preset operation library, it can be understood that a wake-up mechanism adapted to the language habits of the target user is added to the original preset instructions and preset operations. That is to say, based on the language habits of the target user, the original preset instructions and preset operations of "turn on the air conditioner" are modified to use the custom instruction "give some wind" to wake up the custom operation "turn on the air conditioner".

[0071] In one embodiment of the present application, the first instruction and the first operation having a corresponding relationship can be constructed based on the second voice feature and each of the third operations in the following manner, but is not limited to: determining a fifth instruction matching the second voice feature from the preset operation library; copying the fifth instruction and the fifth operation corresponding to the fifth instruction from the preset operation library; using each of the third operations to construct a combined operation; using the combined operation to update the fifth operation to obtain the fifth instruction and the combined operation having a corresponding relationship; and determining the fifth instruction and the combined operation having a corresponding relationship as the first instruction and the first operation having a corresponding relationship.

[0072] Optionally, in this embodiment, when the user adds a combination control based on the preset operation library, he enters the vehicle touch screen interface and selects the new command. Figure 2 A schematic diagram of the vehicle split-screen interface in an embodiment of the present application is shown. Figure 2 As shown, the interface switches to a split screen. The left side is the voice input page, which includes the start recording, recording completion, and cancel recording functions, while the right side is the vehicle control interface. Users control the voice input of commands on the left side of the voice input page and select at least one preset operation on the right side. The system modifies or combines the preset operations based on the command voice to generate corresponding custom commands and custom operations.

[0073] Taking the preset command and preset operation of "turn on the air conditioner" as an example, the user can set the custom command "turn on the air conditioner" and the custom operation "turn on the air conditioner + temperature 27 degrees + air volume 2 level + close all car windows" through the above process.

[0074] It should be noted that the vehicle control functions displayed in the vehicle control interface can be, but are not limited to, determined based on corresponding preset commands and preset operations in the preset operation library. In other words, only when the control operations of the target vehicle are preset can their modification and combination be performed. Furthermore, the vehicle control interface on the right can be displayed in the form of preset commands and preset operations, or in the form of a 3D vehicle model.

[0075] In one embodiment of the present application, the first instruction matching the voice control instruction and the first operation corresponding to the first instruction can be determined from the custom operation library in the following manner, but is not limited to: matching the voice control instruction with each of the custom instructions in the custom operation library; determining the custom instruction matching the voice control instruction as the first instruction, and determining the custom operation corresponding to the first instruction as the first operation; if the custom instruction matching the voice control instruction does not exist in the custom operation library, determining that the first instruction does not exist in the custom operation library.

[0076] Optionally, in this embodiment, a custom instruction that is identical to the voice control instruction may be determined as the first instruction, but is not limited to being determined as such. Alternatively, the similarity between the voice control instruction and each custom instruction may be calculated, and a custom instruction whose similarity to the voice control instruction is greater than or equal to a similarity threshold may be determined as the first instruction.

[0077] In the above process, the accuracy of instruction matching is ensured through a line-by-line comparison algorithm, and the matching failure judgment criteria of the custom library are clarified, providing a decision basis for falling back to the preset library, realizing accurate mapping of instructions to operations, and avoiding false triggering.

[0078] In one embodiment of the present application, the voice control instruction can be matched with each of the custom instructions in the custom operation library in the following manner, but is not limited to: extracting the first voice feature of the voice control instruction; matching the first voice feature with each of the custom instructions in the custom operation library, wherein the custom instruction is used to characterize the voice feature of the corresponding custom operation.

[0079] Optionally, in this embodiment, the custom instruction that matches the first voice feature is determined as the first instruction.

[0080] In the above process, biometric authentication is achieved through voiceprint features to ensure the security of commands; a voice fingerprint library is established to prevent unauthorized users from using custom commands; and the system's ability to prevent accidental touches is improved to only respond to the voiceprint features of registered users.

[0081] In the embodiment provided in step 103 - 2 , the target vehicle may be controlled to perform the first operation through, but not limited to, an electronic control unit (ECU) or a cockpit domain controller of the target vehicle.

[0082] In the embodiment provided in step 104-1, the second instruction matching the voice control instruction and the second operation corresponding to the second instruction can be determined from the preset operation library in the following manner, but is not limited to: matching the voice control instruction with each preset instruction in the preset operation library; determining the preset instruction matching the voice control instruction as the second instruction, and determining the preset operation corresponding to the second instruction as the second operation; if the custom instruction matching the voice control instruction does not exist in the custom operation library.

[0083] In the embodiment provided in step 104 - 2 , the target vehicle may be controlled to perform the second operation through, but not limited to, an electronic control unit (ECU) or a cockpit domain controller of the target vehicle.

[0084] In order to make those skilled in the art better understand the control of the above-mentioned target vehicle, the following will be combined with Figure 3 To explain, Figure 3 A timing diagram showing the control process of the target vehicle in the embodiment of the present application is shown. Figure 3 As shown in the figure, for example, car owner A has purchased a smart electric car equipped with the voice system. He is accustomed to using non-standard commands to control the vehicle (for example, calling "open the trunk" "open the back door"). Car owner A has a special requirement for the air conditioner: when he says "cool down", he wants the air conditioner to automatically set to 20°C and close the windows. For example, the control of this special requirement can be achieved through, but is not limited to, the following process:

[0085] Step 1: User login and voiceprint registration:

[0086] When car owner A uses the vehicle for the first time, he logs in to his personal account through the vehicle touch screen, and the system prompts "Please record your voiceprint"; car owner A says a preset phrase (such as "I am the car owner"), and the microphone array collects the voiceprint features and binds the account; if car owner A is not using the vehicle for the first time, he can load based on the voiceprint or account according to the vehicle settings.

[0087] Step 2: Add custom instructions:

[0088] Car owner A clicks the "Voice Command Customization" option on the touch screen, and the system enters split-screen mode: left side: displays "Speak Your Command" and recording buttons; right side: lists controllable vehicle functions (air conditioning, windows, trunk, etc.).

[0089] Recording the command "cool down": Car owner A clicks the recording button and says "cool down". The system completes the recording and extracts the voiceprint features.

[0090] Bind composite operations: Check the boxes on the right: "Set the air conditioning temperature to 20°C" and "Close all windows".

[0091] Step 3: Voice command execution:

[0092] Trigger command: While driving, car owner A says "cool down", and the microphone array collects the voice in a directionally controlled manner.

[0093] Voiceprint verification and command matching: The system extracts voice features and confirms that it matches "User A's voiceprint."

[0094] Match the instruction "cool down" in the custom operation library and obtain the first bound operation.

[0095] Vehicle control execution: Send instructions via the CAN bus: The air conditioning ECU receives parameters: 20℃; the window controller closes all the vehicle windows.

[0096] The touch screen displays the execution result: "The air conditioner is set to 20℃ and the windows are closed."

[0097] Step 4: Multi-user scene switching:

[0098] Car owner B uses the vehicle: Car owner B logs in to his account, and the system automatically switches to his custom library.

[0099] When car owner B says "cool down": If the command is not customized, the car manufacturer's preset operation (such as air conditioning 24°C) is executed. Or a different operation customized by car owner B (such as only lowering the temperature) is triggered.

[0100] This solution achieves a deeply personalized experience in vehicle voice control by building a two-layer command system that includes a custom operation library and a preset operation library: users can freely add or modify voice commands through voiceprint binding, and accurately bind personalized expressions (such as "turn on the air conditioner") with single or combined vehicle operations (such as air conditioning 20℃ + close the window). The system gives priority to matching user-defined commands for execution, and automatically falls back to the car company's preset commands if a match is not found. This not only meets the user's personalized needs, but also ensures the reliability of basic functions, allowing the car to change with the user.

[0101] The following describes an embodiment of the device of the present application, which can be used to execute the control method of the target vehicle in the above embodiment of the present application. For details not disclosed in the embodiment of the device of the present application, please refer to the embodiment of the control method of the target vehicle in the above embodiment of the present application.

[0102] See also Figure 4 , shows a block diagram of the control device of the target vehicle in an embodiment of the present application.

[0103] like Figure 4 As shown, the control device (400) of the target vehicle according to the embodiment of the present application includes:

[0104] Receiving module 401, first acquiring module 402, first determining module 403-1, first controlling module 403-2, second determining module 404-1 and second controlling module 404-2.

[0105] The receiving module is used to receive the voice control command of the target user;

[0106] A first acquisition module is configured to acquire a target operation library of the target user, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of corresponding custom instructions and custom operations, and the preset operation library includes at least one set of corresponding preset instructions and preset operations;

[0107] a first determining module, configured to determine, from the custom operation library, a first instruction matching the voice control instruction and a first operation corresponding to the first instruction; and a first controlling module, configured to control the target vehicle to perform the first operation;

[0108] The second determination module is used to determine a second instruction matching the voice control instruction and a second operation corresponding to the second instruction from the preset operation library if the first instruction does not exist in the custom operation library; the second control module is used to control the target vehicle to perform the second operation.

[0109] In some embodiments of the present application, based on the aforementioned solution, the first determining module includes:

[0110] a matching unit, configured to match the voice control instruction with each of the custom instructions in the custom operation library;

[0111] a first determining unit, configured to determine the custom instruction matching the voice control instruction as the first instruction, and determine the custom operation corresponding to the first instruction as the first operation;

[0112] The second determining unit is configured to determine that the first instruction does not exist in the custom operation library if the custom instruction matching the voice control instruction does not exist in the custom operation library.

[0113] In some embodiments of the present application, based on the aforementioned scheme, the matching unit is also used to: extract a first voice feature of the voice control instruction; match the first voice feature with each of the custom instructions in the custom operation library, wherein the custom instruction is used to represent the voice feature of the corresponding custom operation.

[0114] In some embodiments of the present application, based on the aforementioned solution, before determining the custom instruction that matches the voice control instruction as the first instruction, the device further includes:

[0115] a second acquisition module, configured to acquire an add instruction triggered by the target user, wherein the add instruction carries a command voice and at least one third operation included in the first operation;

[0116] An extraction module, configured to extract a second voice feature of the command voice;

[0117] a first constructing module, configured to construct the first instruction and the first operation having a corresponding relationship based on the second voice feature and the third operation if the first operation includes a single third operation;

[0118] a second constructing module, configured to construct the first instruction and the first operation having a corresponding relationship based on the second voice feature and each of the third operations if the first operation includes a plurality of the third operations;

[0119] An adding module is used to add the first instruction and the first operation having a corresponding relationship to the custom operation library.

[0120] In some embodiments of the present application, based on the aforementioned scheme, a microphone array and a vehicle touch screen are deployed on the target vehicle, and the second acquisition module is also used to: obtain the command voice issued by the target user through the microphone array; obtain at least one of the third operations clicked by the target user through the vehicle touch screen; if at least one of the third operations and the command voice are received at the same time, it is determined that the target user has triggered the add instruction.

[0121] In some embodiments of the present application, based on the aforementioned scheme, the first building module is also used to: determine a fourth instruction that matches the second voice feature from the preset operation library; copy the fourth instruction and the fourth operation corresponding to the fourth instruction from the preset operation library; use the third operation to update the fourth operation to obtain the fourth instruction and the third operation with a corresponding relationship; determine the fourth instruction and the third operation with a corresponding relationship as the first instruction and the first operation with a corresponding relationship.

[0122] In some embodiments of the present application, based on the aforementioned scheme, the second construction module is also used to: determine a fifth instruction that matches the second voice feature from the preset operation library; copy the fifth instruction and the fifth operation corresponding to the fifth instruction from the preset operation library; use each of the third operations to construct a combined operation; use the combined operation to update the fifth operation to obtain the fifth instruction and the combined operation with a corresponding relationship; determine the fifth instruction and the combined operation with a corresponding relationship as the first instruction and the first operation with a corresponding relationship.

[0123] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium, which stores at least one computer program instruction. The at least one computer program instruction is loaded and executed by a processor to implement the operations performed by the method described above.

[0124] Based on the same inventive concept, the present application also provides an electronic device, referring to Figure 5 , shows a structural diagram of an electronic device in an embodiment of the present application, wherein the electronic device includes one or more memories 504, one or more processors 502, and at least one computer program (computer program instruction) stored in the memory 504 and executable on the processor 502, and when the processor 502 executes the computer program, the method described above is implemented.

[0125] Among them, Figure 5In the embodiment of the present invention, a bus architecture (represented by bus 500) is shown. Bus 500 may include any number of interconnected buses and bridges, and bus 500 links various circuits including one or more processors represented by processor 502 and memory represented by memory 504. Bus 500 may also link various other circuits such as peripherals, voltage regulators, and power management circuits, which are well known in the art and therefore will not be described further herein. Bus interface 505 provides an interface between bus 500 and receiver 501 and transmitter 503. Receiver 501 and transmitter 503 may be the same component, namely a transceiver, which provides a unit for communicating with various other devices over a transmission medium. Processor 502 is responsible for managing bus 500 and general processing, while memory 504 may be used to store data used by processor 502 when performing operations.

[0126] The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored as one or more instructions or codes on or transmitted via a computer-readable medium. Other examples and implementations are within the scope and spirit of this application and the appended claims. For example, due to the nature of software, the functions described above may be implemented using software executed by a processor, hardware, firmware, hardwiring, or a combination of any of these. Furthermore, the functional units may be integrated into a single processing unit, each unit may exist physically separately, or two or more units may be integrated into a single unit.

[0127] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only exemplary. For example, the division of the units can be a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0128] The units described as separate components may or may not be physically separate, and the components of the control device may or may not be physical units, that is, they may be located in one place or distributed across multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0129] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions for enabling a computer device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, magnetic disk or optical disk, etc. Various media that can store computer program instructions.

[0130] The foregoing is merely an embodiment of the present application and is not intended to limit the present application. Various modifications and variations are possible for those skilled in the art. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of the present application shall be included within the scope of the claims of the present application.

Claims

1. A method for controlling a target vehicle, characterized in that: The method comprises: Receive voice control instructions from the target user; Obtaining a target operation library of the target user, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of custom instructions and custom operations with corresponding relationships, and the preset operation library includes at least one set of preset instructions and preset operations with corresponding relationships; Determining a first instruction matching the voice control instruction and a first operation corresponding to the first instruction from the custom operation library; and controlling the target vehicle to perform the first operation; If the first instruction does not exist in the custom operation library, a second instruction matching the voice control instruction and a second operation corresponding to the second instruction are determined from the preset operation library; and the target vehicle is controlled to perform the second operation.

2. The method according to claim 1, characterized in that The determining, from the custom operation library, a first instruction that matches the voice control instruction and a first operation corresponding to the first instruction includes: Matching the voice control instruction with each of the custom instructions in the custom operation library; Determining the custom instruction that matches the voice control instruction as the first instruction, and determining the custom operation corresponding to the first instruction as the first operation; If the custom instruction matching the voice control instruction does not exist in the custom operation library, it is determined that the first instruction does not exist in the custom operation library.

3. The method according to claim 2, characterized in that The matching of the voice control instruction with each of the custom instructions in the custom operation library includes: extracting a first voice feature of the voice control instruction; The first voice feature is matched with each of the custom instructions in the custom operation library, wherein the custom instruction is used to represent the voice feature of the corresponding custom operation.

4. The method according to claim 2, characterized in that Before determining the custom instruction that matches the voice control instruction as the first instruction, the method further includes: Obtaining an add instruction triggered by the target user, wherein the add instruction carries a command voice and at least one third operation included in the first operation; extracting a second voice feature of the command voice; If the first operation includes a single third operation, constructing the first instruction and the first operation having a corresponding relationship based on the second voice feature and the third operation; If the first operation includes a plurality of the third operations, constructing the first instruction and the first operation having a corresponding relationship based on the second voice feature and each of the third operations; Adding the first instruction and the first operation having a corresponding relationship to the custom operation library.

5. The method according to claim 4, characterized in that The target vehicle is equipped with a microphone array and a vehicle touch screen, and obtaining the adding instruction triggered by the target user includes: Acquiring the command voice issued by the target user through the microphone array; Acquire at least one third operation clicked by the target user through the vehicle touch screen; If at least one of the third operation and the instruction voice is received simultaneously, it is determined that the target user has triggered the adding instruction.

6. The method according to claim 4, characterized in that The constructing the first instruction and the first operation having a corresponding relationship based on the second voice feature and the third operation includes: Determining a fourth instruction matching the second voice feature from the preset operation library; copying the fourth instruction and the fourth operation corresponding to the fourth instruction from the preset operation library; Using the third operation to update the fourth operation, to obtain the fourth instruction and the third operation having a corresponding relationship; The fourth instruction and the third operation having a corresponding relationship are determined as the first instruction and the first operation having a corresponding relationship.

7. The method according to claim 4, characterized in that The constructing the first instruction and the first operation having a corresponding relationship based on the second voice feature and each of the third operations includes: Determining a fifth instruction matching the second voice feature from the preset operation library; copying the fifth instruction and the fifth operation corresponding to the fifth instruction from the preset operation library; constructing a combined operation using each of said third operations; Using the combined operation to update the fifth operation, to obtain the fifth instruction and the combined operation having a corresponding relationship; The fifth instruction and the combined operation having a corresponding relationship are determined as the first instruction and the first operation having a corresponding relationship.

8. A control device for a target vehicle, characterized in that: The device comprises: A receiving module, configured to receive a target user's voice control command; A first acquisition module is configured to acquire a target operation library of the target user, wherein the target operation library includes a custom operation library and a preset operation library, the custom operation library includes at least one set of corresponding custom instructions and custom operations, and the preset operation library includes at least one set of corresponding preset instructions and preset operations; a first determining module, configured to determine, from the custom operation library, a first instruction matching the voice control instruction and a first operation corresponding to the first instruction; and a first controlling module, configured to control the target vehicle to perform the first operation; The second determination module is used to determine a second instruction matching the voice control instruction and a second operation corresponding to the second instruction from the preset operation library if the first instruction does not exist in the custom operation library; the second control module is used to control the target vehicle to perform the second operation.

9. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer program instructions, which are loaded and executed by a processor to implement the operations performed by the method according to any one of claims 1 to 7.

10. An electronic device comprising a processor and a memory, characterized in that: The memory stores computer program instructions that can be executed by the processor, and when the processor executes the computer program instructions, the processor implements the method according to any one of claims 1 to 7.

Images