Voice arbitration method and apparatus, and electronic device and vehicle

Abstract

The present application relates to the technical field of vehicles. Disclosed are a voice arbitration method and apparatus, and an electronic device and a vehicle. The method comprises: receiving voice interaction information, and identifying an intent instruction in the voice interaction information; using the intent instruction to match from pre-stored scripts a target script corresponding to the intent instruction; on the basis of arbitration nodes determined by the target script, performing step-by-step arbitration in a pre-constructed arbitration decision tree so as to obtain an arbitration result; and in view of the arbitration result, executing the voice interaction information. Compared with the related art, the present application optimizes existing voice arbitration architecture and arbitration logic, thereby ameliorating the problem of priority logic for determination being not set in a present voice arbitration method, resulting in the arbitration flexibility being relatively low and maintenance not being facilitated.

Description

Voice arbitration method, device, electronic equipment and vehicle

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims priority to the Chinese patent application filed with the China Patent Office on February 28, 2024, with application number 2024102237250 and application name “Voice Arbitration Method, Device, Electronic Device and Vehicle”, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present application relates to the field of vehicle technology, and is related to, but not limited to, a voice arbitration method, device, electronic device, and vehicle. Background Art

[0004] Voice arbitration is a crucial component of the voice chain. Its purpose is to identify, judge, and execute or reject large amounts of conversational information, making decisions based on the foreground application and the current screen usage. However, in practice, each voice message undergoes multiple sentence judgments in the arbitration module. Without a clear precedence logic between these judgments, the arbitration module becomes overwhelmed with judgment statements, resulting in limited flexibility and maintenance issues for voice arbitration. Summary of the Invention

[0005] In view of this, the present application provides a voice arbitration method, device, electronic device and vehicle, which can improve the problems of the current voice arbitration method that has no judgment sequence logic, has poor arbitration flexibility and is not conducive to maintenance.

[0006] In a first aspect, the present application provides a voice arbitration method, comprising:

[0007] Receiving voice interaction information and identifying intended instructions in the voice interaction information;

[0008] Using the intention instruction, a target script corresponding to the intention instruction is matched in a pre-stored script; the pre-stored script is a pre-written script program, and the script program includes an arbitration node for determining an arbitration type, which is used to determine the corresponding arbitration node according to different intentions; the target script is used to determine the arbitration node to be performed on the intention instruction;

[0009] Based on the arbitration nodes determined by the target scenario, arbitration is performed step by step in a pre-constructed arbitration decision tree to obtain an arbitration result; the decision tree includes n levels, n is greater than or equal to 1, and each level includes a number of arbitration nodes;

[0010] The intention instruction is executed in combination with the arbitration result.

[0011] Optionally, the arbitration node determined based on the target script is arbitrated step by step in a pre-constructed arbitration decision tree to obtain an arbitration result, including: judging whether the intention instruction is executable under the current scenario mode based on the arbitration decision tree; if the intention instruction is executable, determining the sound source position of the intention instruction; according to the preset control authority of the sound source position, determining at least one vehicle-mounted screen that can be controlled by the sound source position; and determining the execution screen of the intention instruction among the at least one vehicle-mounted screen.

[0012] Optionally, after determining the execution screen of the intention instruction, the method further includes: using the arbitration decision tree to perform secondary arbitration on the intention instruction, querying the dependency of the execution process of the intention instruction on the vehicle-mounted screen, and obtaining a secondary arbitration result; wherein, the secondary arbitration result includes dependency on the vehicle-mounted screen and non-dependence on the vehicle-mounted screen.

[0013] Optionally, after obtaining the secondary arbitration result, the method further includes: when the secondary arbitration result is dependent on the vehicle-mounted screen, unlocking the execution screen and executing the intention instruction through the execution screen; when the secondary arbitration result is not dependent on the vehicle-mounted screen and the execution screen is not unlocked, executing the intention instruction.

[0014] Optionally, after obtaining the secondary arbitration result, the method further includes: using the arbitration decision tree to perform a third-level arbitration on the intention instruction, searching for the target application in the acquired applications of the execution screen; if the target application is not available in the acquired applications of the execution screen, downloading the target application from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, using the default application as the target application.

[0015] Optionally, the pre-constructed arbitration decision tree includes three arbitration levels;

[0016] The arbitration nodes determined based on the target script are arbitrated step by step in a pre-constructed arbitration decision tree to obtain an arbitration result, including: using the arbitration decision tree to perform a first-level arbitration on the intention instruction to determine the first-level arbitration result; the first-level arbitration result includes judging whether the intention instruction is executable and determining the execution screen of the intention instruction; if the first-level arbitration result is that the intention instruction is executable, performing a second-level arbitration on the intention instruction to determine the second-level arbitration result; the second-level arbitration result includes determining the dependency of the intention instruction on the vehicle screen; after determining the second-level arbitration result, performing a third-level arbitration on the intention instruction to determine the third-level arbitration result; the third-level arbitration result includes determining the target application for executing the intention instruction.

[0017] In a second aspect, the present application provides a voice arbitration method, comprising:

[0018] Receiving voice interaction information from the vehicle and identifying intended instructions in the voice interaction information;

[0019] Arbitrating the intention instruction step by step to obtain an arbitration result;

[0020] Based on the arbitration result, the intention command is executed in the vehicle.

[0021] Optionally, the step-by-step arbitration of the intention instruction to obtain an arbitration result includes:

[0022] Determine whether the intended instruction is executable in the current scenario mode;

[0023] If the intended instruction is executable, determining a sound source position of the intended instruction in the vehicle;

[0024] According to the preset control authority of the sound source position, determining at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source position;

[0025] In the at least one in-vehicle screen, an execution screen for the intended instruction is determined.

[0026] Optionally, after determining the execution screen of the intended instruction, the method further includes:

[0027] Performing secondary arbitration on the intention instruction, querying the dependency of the execution process of the intention instruction on the vehicle-mounted screen in the vehicle, and obtaining a secondary arbitration result;

[0028] The secondary arbitration result includes depending on the on-board screen in the vehicle and not depending on the on-board screen in the vehicle.

[0029] Optionally, after obtaining the secondary arbitration result, the method further includes:

[0030] If the secondary arbitration result is to rely on the vehicle screen, unlock the execution screen and execute the intended instruction through the execution screen;

[0031] When the secondary arbitration result is not dependent on the vehicle-mounted screen, the intention instruction is executed, and the execution screen is not unlocked.

[0032] Optionally, after obtaining the secondary arbitration result, the method further includes:

[0033] Performing three-level arbitration on the intended instruction and searching for a target application in the acquired applications on the execution screen;

[0034] If the target application is not present in the acquired applications on the execution screen, downloading the target application from the application program source on the execution screen;

[0035] In the case that the target application cannot be found in the application source of the execution screen, a default application is used as the target application.

[0036] Optionally, after determining whether the intended instruction is executable in the current scenario mode, the method further includes:

[0037] When it is determined that the intended instruction is not executable in the current scenario mode, a prompt message indicating that the intended instruction corresponding to the voice interaction information is not executed is output.

[0038] In a third aspect, the present application provides a voice arbitration device, comprising:

[0039] A receiving part is configured to receive voice interaction information and identify intended instructions in the voice interaction information;

[0040] The matching part is configured to use the intention instruction to match a target script corresponding to the intention instruction in a pre-stored script; the pre-stored script is a pre-written script program, and the script program includes an arbitration node for determining an arbitration type, which is used to determine the corresponding arbitration node according to different intentions; the target script is used to determine the arbitration node to be performed on the intention instruction;

[0041] An arbitration part is configured to perform arbitration step by step in a pre-built arbitration decision tree based on the arbitration nodes determined by the target scenario to obtain an arbitration result; the decision tree includes n levels, where n is greater than or equal to 1, and each level includes a number of arbitration nodes;

[0042] The execution part is configured to execute the intention instruction in combination with the arbitration result.

[0043] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a first processor, the computer program implements the voice arbitration method described in the first aspect; when the computer program is executed by a second processor, the computer program implements the voice arbitration method described in the second aspect.

[0044] In a fifth aspect, the present application provides an electronic device, comprising a storage medium, a first processor, a second processor, a computer program stored on the storage medium and executable on the first processor, and a computer program stored on the storage medium and executable on the second processor, wherein the first processor implements the voice arbitration method described in the first aspect when executing the computer program, and the second processor implements the voice arbitration method described in the second aspect when executing the computer program.

[0045] In a sixth aspect, the present application provides a vehicle, comprising the voice arbitration device as mentioned in the third aspect or the electronic device as mentioned in the fifth aspect.

[0046] Based on the above technical solution, the present application provides a voice arbitration method, device, electronic device, and vehicle. The method first receives voice interaction information and identifies an intended command. Using the intended command, the method then matches a pre-stored script with a target script corresponding to the intended command. The script is a pre-written script program containing an arbitration node for determining the arbitration type, which is used to determine the corresponding arbitration node based on different intents. The target script is used to determine the arbitration node to be performed for the intended command. Based on the arbitration nodes determined by the target script, a step-by-step arbitration is performed within a pre-constructed arbitration decision tree to obtain an arbitration result. The decision tree comprises n levels, where n is greater than or equal to 1, and each level includes a number of arbitration nodes. Finally, based on the obtained arbitration result, the intended command is executed. Compared to related technologies, the present application clarifies multi-level judgment logic by setting up an arbitration decision tree. Furthermore, through multiple pre-set scripts, the corresponding arbitration node to be performed can be determined for each intended command. Finally, based on the arbitration node, the required arbitration logic can be found within the arbitration decision tree. This optimizes the existing voice arbitration architecture and arbitration logic, addressing the issues of current voice arbitration methods that lack a sequential judgment logic, resulting in poor arbitration flexibility and inconvenient maintenance.

[0047] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0049] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0050] FIG1 shows a flow chart of a voice arbitration method provided in an embodiment of the present application;

[0051] FIG2 shows a processing logic diagram of a voice arbitration method provided in an embodiment of the present application;

[0052] FIG3 shows a schematic structural diagram of a voice arbitration device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] In order to be able to more clearly understand the above-mentioned objects, features and advantages of the present application, the scheme of the present application will be further described below. Although certain embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present application. It should be understood that the drawings and embodiments of the present application are only for illustrative purposes and are not intended to limit the scope of protection of the present application. All other embodiments obtained by those of ordinary skill in the art without making creative work are within the scope of protection of the present application. It should be noted that, in the absence of conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

[0054] In addition, in order to be able to understand the features and technical content of the embodiments of the present application in more detail, the implementation of the embodiments of the present application is described in detail below in conjunction with the accompanying drawings. The accompanying drawings are for reference only and are not intended to limit the embodiments of the present application. In the following technical description, for the sake of convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.

[0055] The voice arbitration method provided in this embodiment is applied to a voice arbitration device, which can be installed in an ECU (Electronic Control Unit) in a vehicle or integrated into an in-vehicle screen with processing capabilities to execute any of the voice arbitration methods provided in the embodiments of this application.

[0056] Specifically, from the perspective of the modules on the entire voice link, the arbitration module used to arbitrate intention instructions can be located between the dialogue central control module (voice module) and the vertical domain management module. The central control module transmits the session information to the arbitration module. After the arbitration module performs a series of arbitration logic judgments such as mode interception and filtering, the arbitration result is passed back to the central control module. The central control module will perform further processing based on the session information.

[0057] To improve the current voice arbitration method, which lacks a logic for determining precedence, resulting in poor arbitration flexibility and inconvenience in maintenance, this embodiment proposes a voice arbitration method. As shown in FIG1 , the method includes:

[0058] S101: Receive voice interaction information and identify intended instructions in the voice interaction information.

[0059] In an embodiment of the present application, voice interaction information can be initiated by the user at any location in the vehicle. These voice interaction information include some execution instructions, such as instructing the vehicle to close the windows, and some inquiry interaction scenarios, such as identifying the user's corresponding intention instructions after multiple inquiries to the vehicle.

[0060] S102: Use the intention instruction to match the target script corresponding to the intention instruction in the pre-stored scripts.

[0061] In an embodiment of the present application, the pre-stored script is a pre-written script program that contains an arbitration node for determining the arbitration type, which is used to determine the corresponding arbitration node according to different intentions. The target script is used to determine the arbitration node to be performed on the intention instruction. Once the arbitration node is determined, it is possible to know which arbitration type needs to be executed in the arbitration decision tree and which arbitration branch to take. Corresponding scripts are set in advance for various situations, thereby ensuring that the intention instructions in various situations can find the corresponding target script.

[0062] Here is an example: "action":"appstore / install", "decision": {"decisionType":"wiki_common_decision", "decisionSecondNodeType":"dependent_driver_screen_end_business", "decisionNodeType":"default_system_app" "decisions":[ "mediaPackage":"com.lixiang.appstore" "mediaType":"appstore" "mediaName":"Application Store"

[0063] In the above script, the decisionType arbitration type is the first-level arbitration node, which is divided according to the domain arbitration module and the corresponding arbitration strategy, such as: default_decision default arbitration, default_vehicle_decision default vehicle control arbitration, common_decision common arbitration, etc.

[0064] The decisionSecondNodeType is a secondary arbitration node that determines screen dependencies. For example, dependent_screen depends on the screen, dependent_screen_opened depends on screen opening, and dependent_screen_part_target depends on the screen. Partial target dependency means that for the same action, whether the instruction depends on the screen depends on the target.

[0065] decisionNodeType: The arbitration node type is a third-level arbitration node, which is determined to be the target application or the default application.

[0066] S103, based on the arbitration nodes determined by the target scenario, arbitration is performed step by step in the pre-built arbitration decision tree to obtain an arbitration result.

[0067] In the embodiment of the present application, the arbitration decision tree comprises n levels, where n is greater than or equal to 1, and each level includes a number of arbitration nodes. The arbitration decision tree is a logical architecture with a hierarchical order of judgment. After arbitrating the intent command at each level, the arbitration result for the intent command can be obtained. By supplementing the precedence judgment logic in the arbitration decision tree, the existing voice arbitration architecture and arbitration logic are optimized.

[0068] S104: Execute the voice interaction information based on the arbitration result.

[0069] In an embodiment of the present application, voice interaction information is first received and an intended instruction is identified. Using the intended instruction, a target script corresponding to the intended instruction is matched against a pre-stored script. Here, the script is a pre-written script program containing an arbitration node for determining the arbitration type, which is used to determine the corresponding arbitration node based on different intents. The target script is used to determine the arbitration node to be performed for the intended instruction. Then, based on the arbitration nodes determined by the target script, a step-by-step arbitration is performed in a pre-constructed arbitration decision tree to obtain an arbitration result. The decision tree comprises n levels, where n is greater than or equal to 1, and each level comprises a number of arbitration nodes. Finally, based on the obtained arbitration result, the intended instruction is executed. Compared with related technologies, the present application clarifies multi-level judgment logic by setting up an arbitration decision tree. Furthermore, through multiple pre-set scripts, the corresponding arbitration node to be performed can be determined for each intended instruction. Finally, based on the arbitration node, the required arbitration logic can be found in the arbitration decision tree. This optimizes the existing voice arbitration architecture and arbitration logic, improving the current voice arbitration method, which lacks a sequential judgment logic, resulting in poor arbitration flexibility and inconvenient maintenance.

[0070] In some embodiments, whether the intended instruction is executable in the current scenario mode is determined based on the arbitration decision tree; if the intended instruction is executable, the sound source position of the intended instruction is determined; according to the preset control authority of the sound source position, at least one vehicle-mounted screen that can be controlled by the sound source position is determined; and among the at least one vehicle-mounted screen, the execution screen of the intended instruction is determined.

[0071] In this embodiment, the purpose of the first-level arbitration includes determining whether the intended instruction is executable and determining the execution screen of the intended instruction. The purpose of the first-level arbitration of the intended instruction is to determine whether the intended instruction can be executed in the current vehicle scenario mode. If the intended instruction is not supported in the current mode, a rejection message and related prompts are directly returned, thereby eliminating the subsequent judgment steps and reducing signaling overhead. At the same time, when the vehicle scenario mode is determined, if the current mode can support the intended instruction, the subsequent judgment process can be further clarified in a specific vehicle scenario mode. For example, if the scenario mode is driving mode, most entertainment instructions can be implemented in this mode. After determining that the vehicle is in driving mode, subsequent judgments can be provided based on the requirements of the driving mode, and voice arbitration judgments for non-driving modes are no longer performed.

[0072] Intended commands can be initiated by the user from anywhere in the vehicle, and can be on one or more of the vehicle's in-car screens. For example, a user in the passenger seat initiates an intent command, which is simultaneously received by the three in-car screens located in the driver's seat, passenger seat, and rear seats. Based on pre-set control permissions, the passenger seat screen has control authority, so the passenger seat screen is selected as the screen to execute the user's intent command. The scenario mode indicates whether the vehicle is currently operating in a special scenario. In these operating modes, some commands may not be executed. The decision on whether a command can be executed is determined by a script and an arbitration decision tree. Special operating modes include nap mode, screen cleaning mode, auto show mode, test drive mode, and some dependent situations, such as the absence of a rear screen, the rear screen being turned off, and unsupported in R gear. There are also special rejection situations, such as when some intent commands cannot be executed due to temporary development or vehicle model differences. For example, voice decision-making is generally not performed in auto show mode.

[0073] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then judge whether the intention instruction is executable in the current scenario mode based on the arbitration node in the pre-built arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; thereby, the judgment result of whether the intention instruction is executable in the current scenario mode and the execution screen are determined as the arbitration result; and execute the intention instruction in combination with the arbitration result.

[0074] It should be noted that the process of performing first-level arbitration in a pre-constructed arbitration decision tree based on the arbitration node includes: judging whether the intention instruction is executable in the current scenario mode based on the arbitration decision tree; if the intention instruction is executable, determining the sound source position of the intention instruction; according to the preset control authority of the sound source position, determining at least one vehicle-mounted screen that can be controlled by the sound source position; and determining the execution screen of the intention instruction among the at least one vehicle-mounted screen.

[0075] It should also be noted that the first-level arbitration result includes a determination result of whether the intended instruction is executable and a determined execution screen for executing the intended instruction.

[0076] In some embodiments, after determining the execution screen of the intention instruction, the method also includes: using the arbitration decision tree to perform secondary arbitration on the intention instruction, querying the dependency of the execution process of the intention instruction on the vehicle screen, and obtaining the secondary arbitration result; wherein the secondary arbitration result includes dependency on the vehicle screen and non-dependence on the vehicle screen.

[0077] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then judge whether the intention instruction is executable in the current scenario mode based on the arbitration node in the pre-built arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; then use the arbitration decision tree to perform secondary arbitration on the intention instruction, query the dependency of the execution process of the intention instruction on the vehicle-mounted screen, and obtain the secondary arbitration result; use the first-level arbitration result (the judgment result of whether the intention instruction is executable and the determined execution screen for executing the intention instruction) and the secondary arbitration result as the final arbitration result. Combined with the final arbitration result, execute the intention instruction.

[0078] It should be noted that the result of the secondary arbitration is to rely on the vehicle-mounted screen or not to rely on the vehicle-mounted screen.

[0079] For example, if the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, and the second-level arbitration result is to rely on the vehicle screen, then the intended instruction is executed using display screen A. If the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, and the second-level arbitration result is not to rely on the vehicle screen, then the intended instruction is executed, and display screen A will not be used in the process of executing the intended instruction.

[0080] Furthermore, after obtaining the secondary arbitration result, the method also includes: when the secondary arbitration result is dependent on the vehicle-mounted screen, unlocking the execution screen and executing the intention instruction through the execution screen; when the secondary arbitration result is not dependent on the vehicle-mounted screen and the execution screen is not unlocked, executing the intention instruction.

[0081] In this embodiment, the main purpose of the secondary arbitration is to determine whether the execution of the intended instruction requires dependence on the screen. For example, watching a movie requires unlocking the screen, while playing music does not require unlocking the screen. At the same time, the execution screen has been determined in the primary arbitration, so the secondary arbitration is to determine whether to unlock the execution screen. For example, the instruction to "play a certain music through application A" or the instruction to communicate via Bluetooth phone does not require unlocking the screen. The primary arbitration determines that the instruction is executable and determines the corresponding execution screen. The secondary arbitration determines whether the instruction requires unlocking the execution screen. It should be noted that unlocking is only for the use of the screen. Other functions can also be realized without unlocking, such as checking the weather.

[0082] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then judge whether the intention instruction is executable in the current scenario mode based on the arbitration node in the pre-built arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; then use the arbitration decision tree to perform secondary arbitration on the intention instruction, query the dependency of the execution process of the intention instruction on the vehicle-mounted screen, and obtain the secondary arbitration result; use the first-level arbitration result (the judgment result of whether the intention instruction is executable and the determined execution screen for executing the intention instruction) and the second-level arbitration result as the final arbitration result. When the secondary arbitration result is dependent on the vehicle screen, the execution screen is unlocked and the intention instruction is executed through the execution screen; when the secondary arbitration result is not dependent on the vehicle screen and the execution screen is not unlocked, the intention instruction is executed.

[0083] It should be noted that, in combination with the final arbitration result, the process of executing the intention instruction includes: when the secondary arbitration result is dependent on the vehicle-mounted screen and the primary arbitration result includes executing the intention instruction, unlocking the execution screen and executing the intention instruction through the execution screen; when the secondary arbitration result is not dependent on the vehicle-mounted screen, the primary arbitration result includes executing the intention instruction, and the execution screen is not unlocked, executing the intention instruction.

[0084] In the embodiment of the present application, if the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, and the second-level arbitration result is to rely on the vehicle screen, then display screen A is unlocked and the intended instruction is executed using display screen A. If the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, the second-level arbitration result is not to rely on the vehicle screen, and display screen A is not unlocked, then the intended instruction is executed, and display screen A will not be used in the process of executing the intended instruction.

[0085] In some embodiments, after obtaining the secondary arbitration result, the method also includes: using the arbitration decision tree to perform three-level arbitration on the intent instruction, searching for the target application in the acquired applications of the execution screen; if there is no target application in the acquired applications of the execution screen, downloading the target application from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, using the default application as the target application.

[0086] For example, when the second-level arbitration result is that the screen needs to be unlocked, that is, the execution of the voice command depends on the screen (the voice command is to play a movie through application A on the co-pilot), a third-level arbitration is performed based on the arbitration decision tree, and application A is searched for in the acquired applications of the execution screen. If it is available, the movie is played using application A; if not, application A is downloaded from the application source of the execution screen (such as an app store or cloud store). If the application source cannot find application A, the movie is played through the default application (such as the player built into the execution platform).

[0087] In this embodiment, the purpose of the three-level arbitration is to determine the target application. Specifically, this may include searching for the target application among the acquired applications. If the target application exists, it is executed using the target application; if not, it is downloaded from the cloud or executed using the default application. Of course, other judgments such as determining the current status of the target application, whether it is playing other content, and whether to switch to it can also be included to increase arbitration flexibility.

[0088] In an embodiment of the present application, after receiving voice interaction information and identifying the intended instruction in the voice interaction information, the intended instruction can be used to match the target script corresponding to the intended instruction in the pre-stored script; an arbitration node is determined based on the target script, and then based on the arbitration node, a judgment is made in a pre-built arbitration decision tree as to whether the intended instruction is executable in the current scenario mode; if the intended instruction is executable, the sound source position of the intended instruction is determined; according to the preset control authority of the sound source position, at least one vehicle-mounted screen that can be controlled by the sound source position is determined; among the at least one vehicle-mounted screen, the execution screen of the intended instruction is determined; and the arbitration decision tree is used to perform secondary arbitration on the intended instruction. Query the dependency of the execution process of the intention instruction on the vehicle screen to obtain a secondary arbitration result; finally, use the arbitration decision tree to conduct a three-level arbitration on the intention instruction, and search for the target application in the acquired applications of the execution screen; if the target application is not available in the acquired applications of the execution screen, download the target application from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, use the default application as the target application, thereby obtaining a three-level arbitration result; use the first-level arbitration result (the judgment result of whether the intention instruction is executable and the execution screen determined to execute the intention instruction), the second-level arbitration result, and the third-level arbitration result as the final arbitration result. Combined with the final arbitration result, execute the intention instruction.

[0089] It should be noted that the third-level arbitration results include the target application.

[0090] In an embodiment of the present application, if the arbitration result includes a first-level arbitration result, a second-level arbitration result, and a third-level arbitration result, then in combination with the final arbitration result, the process of executing the intention instruction includes: when the first-level arbitration result includes executing the intention instruction, the second-level arbitration result includes relying on the vehicle screen, and the third-level arbitration result includes the target application, the target application can be searched in the execution screen, and when the target application is found, the intention instruction is executed based on the target application.

[0091] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script, determine the arbitration node based on the target script, and then judge whether the intention instruction is executable in the current scenario mode based on the arbitration node in the pre-built arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; determine the execution screen of the intention instruction among the at least one vehicle-mounted screen; and use the arbitration decision tree Perform secondary arbitration on the intention instruction, query the dependency of the execution process of the intention instruction on the vehicle screen, and obtain a secondary arbitration result; if the secondary arbitration result is dependency on the vehicle screen, unlock the execution screen, and execute the intention instruction through the execution screen; finally, perform tertiary arbitration on the intention instruction using the arbitration decision tree, and search for the target application in the acquired applications of the execution screen; if the target application is not available in the acquired applications of the execution screen, download the target application from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, use the default application as the target application.

[0092] In some embodiments, a pre-built arbitration decision tree includes three arbitration levels. In this case, based on the arbitration nodes determined by the target scenario, arbitration is performed level by level within the pre-built arbitration decision tree to obtain an arbitration result, including: using the arbitration decision tree to conduct a first-level arbitration on the intent instruction and determine the first-level arbitration result; the first-level arbitration result includes determining whether the intent instruction is executable and determining the execution screen of the intent instruction; if the first-level arbitration result is that the intent instruction is executable, the intent instruction is subjected to a second-level arbitration to determine the second-level arbitration result; the second-level arbitration result includes determining the dependency of the intent instruction on the vehicle screen; after determining the second-level arbitration result, the intent instruction is subjected to a third-level arbitration to determine the third-level arbitration result; the third-level arbitration result includes determining the target application for executing the intent instruction.

[0093] In this embodiment, a voice command from a user is first received and the current vehicle scenario is retrieved. Using a pre-stored script and scenario, the voice command undergoes a first-level arbitration process to determine whether the command is executable. If the command is determined to be executable, the voice command undergoes a second-level arbitration process to determine a second-level arbitration result. This second-level arbitration result includes determining the voice command's dependency on the vehicle's display. After determining the second-level arbitration result, the voice command undergoes a third-level arbitration process to determine a third-level arbitration result. This third-level arbitration result includes determining the target application for executing the voice command. The voice command is then executed based on the first, second, and third-level arbitration results. Compared to related technologies, this embodiment abstracts complex, multi-level judgment statements into three levels of arbitration logic, performing comprehensive arbitration based on command supportability, screen dependency, and application feasibility. This optimizes the existing voice arbitration architecture and logic, making them clearer and more concise, eliminating the need for multiple rounds of judgment. This improves existing voice arbitration methods, which suffer from poor arbitration flexibility and poor maintenance.

[0094] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; the arbitration node is determined based on the target script, and then the intention instruction is subjected to first-level arbitration in a pre-constructed arbitration decision tree based on the arbitration node to determine the first-level arbitration result; if the first-level arbitration result is that the intention instruction is executable, the intention instruction is subjected to second-level arbitration to determine the second-level arbitration result; after determining the second-level arbitration result, the intention instruction is subjected to third-level arbitration to determine the third-level arbitration result; and the intention instruction is executed in combination with the first-level arbitration result, the second-level arbitration result and the third-level arbitration result.

[0095] It should be noted that the first-level arbitration result includes determining whether the intention instruction is executable and determining the execution screen of the intention instruction; the second-level arbitration result includes determining the dependency of the intention instruction on the vehicle screen; the third-level arbitration result includes determining the target application used to execute the intention instruction.

[0096] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then perform step-by-step arbitration in a pre-constructed arbitration decision tree based on the arbitration node, specifically: based on the arbitration decision tree, determine whether the intention instruction is executable in the current scenario mode; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; use the judgment result of whether the execution screen and the intention instruction are executable as the first-level arbitration result; if the first-level arbitration result is that the intention instruction is executable, perform second-level arbitration on the intention instruction to determine the second-level arbitration result; after determining the second-level arbitration result, perform third-level arbitration on the intention instruction to determine the third-level arbitration result; combine the first-level arbitration result, the second-level arbitration result and the third-level arbitration result to execute the intention instruction.

[0097] In an embodiment of the present application, after receiving voice interaction information and identifying the intended instruction in the voice interaction information, the intended instruction can be used to match a target script corresponding to the intended instruction in a pre-stored script; an arbitration node is determined based on the target script, and then a level-by-level arbitration is performed in a pre-constructed arbitration decision tree based on the arbitration node. Specifically, based on the arbitration decision tree, it is determined whether the intended instruction is executable in the current scenario mode; if the intended instruction is executable, the sound source location of the intended instruction is determined; according to the preset control authority of the sound source location, at least one vehicle-mounted screen that can be controlled by the sound source location is determined; among the at least one vehicle-mounted screen, the execution screen of the intended instruction is determined; the judgment result of whether the execution screen and the intended instruction are executable is used as the first-level arbitration result; if the first-level arbitration result is that the intended instruction is executable, the arbitration decision tree is used to perform a second-level arbitration on the intended instruction, and the dependency of the execution process of the intended instruction on the vehicle-mounted screen is queried to obtain a second-level arbitration result (the second-level arbitration result includes dependence on the vehicle-mounted screen or not dependence on the vehicle-mounted screen); after determining the second-level arbitration result, the intention instruction is subjected to a third-level arbitration to determine the third-level arbitration result. Finally, the intention instruction is executed by combining the first-level arbitration results, the second-level arbitration results and the third-level arbitration results.

[0098] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then perform step-by-step arbitration in the pre-constructed arbitration decision tree based on the arbitration node, specifically: determine whether the intention instruction is executable in the current scenario mode based on the arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; use the judgment result of whether the execution screen and the intention instruction are executable as the first level Arbitration result; when the first-level arbitration result is that the intention instruction is executable, the arbitration decision tree is used to perform a second-level arbitration on the intention instruction, and the dependency of the execution process of the intention instruction on the vehicle screen is queried to obtain a second-level arbitration result (the second-level arbitration result includes dependency on the vehicle screen or non-dependence on the vehicle screen); when the second-level arbitration result is dependency on the vehicle screen, the execution screen is unlocked, and the intention instruction is executed through the execution screen; when the second-level arbitration result is non-dependence on the vehicle screen and the execution screen is not unlocked, the intention instruction is executed; after determining the second-level arbitration result, the intention instruction is subjected to a third-level arbitration to determine the third-level arbitration result; finally, the first-level arbitration result, the second-level arbitration result and the third-level arbitration result are combined to execute the intention instruction.

[0099] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then perform step-by-step arbitration in the pre-constructed arbitration decision tree based on the arbitration node, specifically: determine whether the intention instruction is executable in the current scenario mode based on the arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; use the judgment result of whether the execution screen and the intention instruction are executable as First-level arbitration result; when the first-level arbitration result is that the intention instruction is executable, the arbitration decision tree is used to perform second-level arbitration on the intention instruction, and the dependency of the execution process of the intention instruction on the vehicle screen is queried to obtain a second-level arbitration result (the second-level arbitration result includes dependency on the vehicle screen or non-dependence on the vehicle screen); after determining the second-level arbitration result, the arbitration decision tree is used to perform third-level arbitration on the intention instruction, and the target application is searched for in the acquired applications of the execution screen; when the target application is not found in the acquired applications of the execution screen, the target application is downloaded from the application source of the execution screen; when the target application cannot be found in the application source of the execution screen, the default application is used as the target application to obtain a third-level arbitration result. Combine the first-level arbitration result, the second-level arbitration result, and the third-level arbitration result to execute the intention instruction.

[0100] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then perform step-by-step arbitration in the pre-constructed arbitration decision tree based on the arbitration node, specifically: determine whether the intention instruction is executable in the current scenario mode based on the arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; and judge the execution screen and whether the intention instruction is executable. as the first-level arbitration result; if the first-level arbitration result is that the intention instruction is executable, the arbitration decision tree is used to perform a second-level arbitration on the intention instruction, and the dependency of the execution process of the intention instruction on the vehicle screen is queried to obtain a second-level arbitration result; if the second-level arbitration result is dependent on the vehicle screen, the execution screen is unlocked, and the arbitration decision tree is used to perform a third-level arbitration on the intention instruction, and the target application is searched for in the acquired applications of the execution screen; if the target application is not found in the acquired applications of the execution screen, the target application is downloaded from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, the default application is used as the target application to obtain a third-level arbitration result. The intention instruction is executed in combination with the first-level arbitration result, the second-level arbitration result, and the third-level arbitration result.

[0101] Regarding script implementation, an example of an arbitration decision tree data structure is provided. As shown in Figure 2, this tree employs a binary tree structure consisting of branch nodes and leaf nodes, and the arbitration decision logic is implemented using XML. Each node, also known as an arbitration node, is matched to the corresponding arbitration node using a pre-written script (including code), leading to a step-by-step arbitration process, resulting in a final arbitration result. Root node 2, root node 3, and leaf node 1 represent the results of first-level arbitration. For example, root node 2 indicates that the instruction is executable when the scenario is A; root node 3 indicates that the instruction is executable when the scenario is B; and leaf node 1 indicates that the instruction is not supported under the current scenario. Root nodes 4, root node 5, leaf nodes 2, and leaf nodes 3 represent the results of second-level arbitration, while leaf nodes 4-7 represent the results of third-level arbitration. Each leaf node requires a corresponding script to execute the result. The voice arbitration process traverses the tree from top to bottom, going through three levels of arbitration until a leaf node is found and arbitration is completed. The decision result is contained in the code of each leaf node.

[0102] Faced with an ever-increasing volume of voice commands, the aforementioned strategy structure allows for a more convenient entry into the arbitration world than the previously used, step-by-step approach. Furthermore, from a maintenance perspective, the arbitration world, layered with if-else statements, is like a stacked tower. Through the interplay of factors such as the width and strength of the underlying bricks, the distribution and balance of gravity, and the cohesion between the bricks, it is possible to remove or add one brick at a time without causing the entire structure to collapse. The same applies to arbitration logic, and this structure enables scalability, flexibility, and security.

[0103] To improve the problem that current voice arbitration methods lack a precedence logic for judgment, resulting in poor arbitration flexibility and inconvenience in maintenance, this embodiment proposes a voice arbitration method, including:

[0104] S201: Receive voice interaction information from a vehicle and identify intended instructions in the voice interaction information.

[0105] In an embodiment of the present application, voice interaction information can be initiated by the user at any location in the vehicle. These voice interaction information include some execution instructions, such as instructing the vehicle to close the windows, and some inquiry interaction scenarios, such as identifying the user's corresponding intention instructions after multiple inquiries to the vehicle.

[0106] S202: Arbitrate the intention instruction step by step to obtain an arbitration result.

[0107] In an embodiment of the present application, after identifying the intended instruction in the voice interaction information, the intended instruction can be arbitrated step by step to obtain an arbitration result.

[0108] In an embodiment of the present application, an arbitration decision tree can be set up to arbitrate the intent instruction step by step using the arbitration decision tree to obtain an arbitration result. Specifically, using the intent instruction, a target script corresponding to the intent instruction is matched in pre-stored scripts; based on the arbitration nodes determined by the target script, arbitration is performed step by step in the pre-built arbitration decision tree to obtain an arbitration result.

[0109] It should be noted that a pre-stored script is a pre-written script program that contains an arbitration node for determining the arbitration type. This is used to determine the corresponding arbitration node based on different intents. The target script is used to determine the arbitration node to be executed for the intent instruction. Determining the arbitration node determines which arbitration type to execute and which arbitration branch to follow in the arbitration decision tree. Corresponding scripts are pre-set for various scenarios, ensuring that the intent instructions in various situations can find the corresponding target script.

[0110] Here is an example: "action":"appstore / install", "decision": {"decisionType":"wiki_common_decision", "decisionSecondNodeType":"dependent_driver_screen_end_business", "decisionNodeType":"default_system_app" "decisions":[ "mediaPackage":"com.lixiang.appstore" "mediaType":"appstore" "mediaName":"Application Store"

[0111] In the above script, the decisionType arbitration type is the first-level arbitration node, which is divided according to the domain arbitration module and the corresponding arbitration strategy, such as: default_decision default arbitration, default_vehicle_decision default vehicle control arbitration, common_decision common arbitration, etc.

[0112] The decisionSecondNodeType is a secondary arbitration node that determines screen dependencies. For example, dependent_screen depends on the screen, dependent_screen_opened depends on screen opening, and dependent_screen_part_target depends on the screen. Partial target dependency means that for the same action, whether the instruction depends on the screen depends on the target.

[0113] decisionNodeType: The arbitration node type is a third-level arbitration node, which is determined to be the target application or the default application.

[0114] In the embodiment of the present application, the arbitration decision tree comprises n levels, where n is greater than or equal to 1, and each level includes a number of arbitration nodes. The arbitration decision tree is a logical architecture with a hierarchical order of judgment. After arbitrating the intent command at each level, the arbitration result for the intent command can be obtained. By supplementing the precedence judgment logic in the arbitration decision tree, the existing voice arbitration architecture and arbitration logic are optimized.

[0115] S203: Execute the voice interaction information based on the arbitration result.

[0116] In an embodiment of the present application, voice interaction information is first received and an intended instruction is identified. Using the intended instruction, a target script corresponding to the intended instruction is matched against a pre-stored script. Here, the script is a pre-written script program containing an arbitration node for determining the arbitration type, which is used to determine the corresponding arbitration node based on different intents. The target script is used to determine the arbitration node to be performed for the intended instruction. Then, based on the arbitration nodes determined by the target script, a step-by-step arbitration is performed in a pre-constructed arbitration decision tree to obtain an arbitration result. The decision tree comprises n levels, where n is greater than or equal to 1, and each level comprises a number of arbitration nodes. Finally, based on the obtained arbitration result, the intended instruction is executed. Compared with related technologies, the present application clarifies multi-level judgment logic by setting up an arbitration decision tree. Furthermore, through multiple pre-set scripts, the corresponding arbitration node to be performed can be determined for each intended instruction. Finally, based on the arbitration node, the required arbitration logic can be found in the arbitration decision tree. This optimizes the existing voice arbitration architecture and arbitration logic, improving the current voice arbitration method, which lacks a sequential judgment logic, resulting in poor arbitration flexibility and inconvenient maintenance.

[0117] In some embodiments, a determination is made as to whether the intended instruction is executable in the current scenario mode; if the intended instruction is executable, the sound source location of the intended instruction in the vehicle is determined; according to the preset control authority of the sound source location, at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source location is determined; and among the at least one vehicle-mounted screen, the execution screen of the intended instruction is determined.

[0118] In an embodiment of the present application, whether the intended instruction is executable in the current scenario mode can be determined based on the arbitration decision tree.

[0119] In this embodiment, the purpose of the first-level arbitration includes determining whether the intended instruction is executable and determining the execution screen of the intended instruction. The purpose of the first-level arbitration of the intended instruction is to determine whether the intended instruction can be executed in the current vehicle scenario mode. If the intended instruction is not supported in the current mode, a rejection message and related prompts are directly returned, thereby eliminating the subsequent judgment steps and reducing signaling overhead. At the same time, when the vehicle scenario mode is determined, if the current mode can support the intended instruction, the subsequent judgment process can be further clarified in a specific vehicle scenario mode. For example, if the scenario mode is driving mode, most entertainment instructions can be implemented in this mode. After determining that the vehicle is in driving mode, subsequent judgments can be provided based on the requirements of the driving mode, and voice arbitration judgments for non-driving modes are no longer performed.

[0120] Intended commands can be initiated by the user from anywhere in the vehicle, and can be on one or more of the vehicle's in-car screens. For example, a user in the passenger seat initiates an intent command, which is simultaneously received by the three in-car screens located in the driver's seat, passenger seat, and rear seats. Based on pre-set control permissions, the passenger seat screen has control authority, so the passenger seat screen is selected as the screen to execute the user's intent command. The scenario mode indicates whether the vehicle is currently operating in a special scenario. In these operating modes, some commands may not be executed. The decision on whether a command can be executed is determined by a script and an arbitration decision tree. Special operating modes include nap mode, screen cleaning mode, auto show mode, test drive mode, and some dependent situations, such as the absence of a rear screen, the rear screen being turned off, and unsupported in R gear. There are also special rejection situations, such as when some intent commands cannot be executed due to temporary development or vehicle model differences. For example, voice decision-making is generally not performed in auto show mode.

[0121] In an embodiment of the present application, after receiving voice interaction information and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then judge whether the intention instruction is executable in the current scenario mode based on the arbitration node in the pre-built arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction in the vehicle; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; thereby, the judgment result of whether the intention instruction is executable in the current scenario mode and the execution screen are determined as the arbitration result; and execute the intention instruction in combination with the arbitration result.

[0122] It should be noted that the process of performing first-level arbitration in a pre-constructed arbitration decision tree based on the arbitration node includes: judging whether the intention instruction is executable in the current scenario mode based on the arbitration decision tree; if the intention instruction is executable, determining the sound source position of the intention instruction in the vehicle; according to the preset control authority of the sound source position, determining at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source position; and determining the execution screen of the intention instruction among the at least one vehicle-mounted screen.

[0123] It should also be noted that the first-level arbitration result includes a determination result of whether the intended instruction is executable and a determined execution screen for executing the intended instruction.

[0124] In some embodiments, after determining the execution screen of the intention instruction, the method also includes: performing secondary arbitration on the intention instruction, querying the dependency of the execution process of the intention instruction on the on-board screen in the vehicle, and obtaining a secondary arbitration result; wherein, the secondary arbitration result includes dependency on the on-board screen in the vehicle and non-dependence on the on-board screen in the vehicle.

[0125] In an embodiment of the present application, the arbitration decision tree can be used to perform secondary arbitration on the intention instruction, query the dependency of the execution process of the intention instruction on the on-board screen in the vehicle, and obtain the secondary arbitration result.

[0126] In an embodiment of the present application, after receiving voice interaction information on a vehicle and identifying the intended instruction in the voice interaction information, the intended instruction can be used to match a target script corresponding to the intended instruction in a pre-stored script; determine an arbitration node based on the target script, and then determine whether the intended instruction is executable in the current scenario mode based on the arbitration node in a pre-built arbitration decision tree; if the intended instruction is executable, determine the sound source position of the intended instruction in the vehicle; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intended instruction; then use the arbitration decision tree to perform secondary arbitration on the intended instruction, query the dependency of the execution process of the intended instruction on the vehicle-mounted screen in the vehicle, and obtain a secondary arbitration result; use the first-level arbitration result (the judgment result of whether the intended instruction is executable and the determined execution screen for executing the intended instruction) and the second-level arbitration result as the final arbitration result. Combined with the final arbitration result, execute the intended instruction.

[0127] It should be noted that the result of the secondary arbitration is to rely on the vehicle-mounted screen or not to rely on the vehicle-mounted screen.

[0128] For example, if the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, and the second-level arbitration result is to rely on the vehicle screen, then the intended instruction is executed using display screen A. If the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, and the second-level arbitration result is not to rely on the vehicle screen, then the intended instruction is executed, and display screen A will not be used in the process of executing the intended instruction.

[0129] Furthermore, after obtaining the secondary arbitration result, the method also includes: when the secondary arbitration result is dependent on the vehicle-mounted screen, unlocking the execution screen and executing the intention instruction through the execution screen; when the secondary arbitration result is not dependent on the vehicle-mounted screen, executing the intention instruction and not unlocking the execution screen.

[0130] In this embodiment, the main purpose of the secondary arbitration is to determine whether the execution of the intended instruction requires dependence on the screen. For example, watching a movie requires unlocking the screen, while playing music does not require unlocking the screen. At the same time, the execution screen has been determined in the primary arbitration, so the secondary arbitration is to determine whether to unlock the execution screen. For example, the instruction to "play a certain music through application A" or the instruction to communicate via Bluetooth phone does not require unlocking the screen. The primary arbitration determines that the instruction is executable and determines the corresponding execution screen. The secondary arbitration determines whether the instruction requires unlocking the execution screen. It should be noted that unlocking is only for the use of the screen. Other functions can also be realized without unlocking, such as checking the weather.

[0131] In an embodiment of the present application, after receiving the voice interaction information of the vehicle and identifying the intention instruction in the voice interaction information, the intention instruction can be used to match the target script corresponding to the intention instruction in the pre-stored script; determine the arbitration node based on the target script, and then judge whether the intention instruction is executable in the current scenario mode based on the arbitration node in the pre-built arbitration decision tree; if the intention instruction is executable, determine the sound source position of the intention instruction in the vehicle; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source position; among the at least one vehicle-mounted screen, determine the execution screen of the intention instruction; then use the arbitration decision tree to perform secondary arbitration on the intention instruction, query the dependency of the execution process of the intention instruction on the vehicle-mounted screen in the vehicle, and obtain a secondary arbitration result; use the first-level arbitration result (the judgment result of whether the intention instruction is executable and the determined execution screen for executing the intention instruction) and the second-level arbitration result as the final arbitration result. When the secondary arbitration result is dependent on the vehicle-mounted screen, the execution screen is unlocked, and the intention instruction is executed through the execution screen; when the secondary arbitration result is not dependent on the vehicle-mounted screen, the intention instruction is executed, and the execution screen is not unlocked.

[0132] It should be noted that, in combination with the final arbitration result, the process of executing the intention instruction includes: when the secondary arbitration result is dependent on the vehicle-mounted screen and the primary arbitration result includes executing the intention instruction, the execution screen is unlocked and the intention instruction is executed through the execution screen; when the secondary arbitration result is not dependent on the vehicle-mounted screen and the primary arbitration result includes executing the intention instruction, the intention instruction is executed and the execution screen is not unlocked.

[0133] In the embodiment of the present application, if the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, and the second-level arbitration result is to rely on the vehicle screen, then display screen A is unlocked and the intended instruction is executed using display screen A. If the first-level arbitration result is to execute the intended instruction, the execution screen is display screen A, and the second-level arbitration result is not to rely on the vehicle screen, then the intended instruction is executed, and display screen A is not unlocked, and display screen A will not be used in the process of executing the intended instruction.

[0134] In some embodiments, after obtaining the secondary arbitration result, the method also includes: performing tertiary arbitration on the intent instruction, searching for the target application in the acquired applications of the execution screen; if there is no target application in the acquired applications of the execution screen, downloading the target application from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, using the default application as the target application.

[0135] In the embodiment of the present application, an arbitration decision tree may be used to perform three-level arbitration on the intended instruction, and the target application may be searched among the acquired applications on the execution screen.

[0136] For example, when the secondary arbitration result is that the screen needs to be unlocked, that is, the execution of the voice command depends on the screen (the voice command is to play a movie through application A on the co-pilot), the intention command is arbitrated at the third level based on the arbitration decision tree, and application A is searched for in the acquired applications of the execution screen. If it exists, the movie is played using application A; if not, application A is downloaded from the application source of the execution screen (such as an application store or a cloud store). If the application source cannot find application A, it is played through the default application (such as the player program that comes with the execution platform).

[0137] In this embodiment, the purpose of the three-level arbitration is to determine the target application. Specifically, this may include searching for the target application among the acquired applications. If the target application exists, it is executed using the target application; if not, it is downloaded from the cloud or executed using the default application. Of course, other judgments such as determining the current status of the target application, whether it is playing other content, and whether to switch to it can also be included to increase arbitration flexibility.

[0138] In an embodiment of the present application, after receiving voice interaction information on the vehicle and identifying the intended instruction in the voice interaction information, the intended instruction can be used to match the target script corresponding to the intended instruction in the pre-stored script; determine the arbitration node based on the target script, and then judge whether the intended instruction is executable in the current scenario mode based on the arbitration node in the pre-built arbitration decision tree; if the intended instruction is executable, determine the sound source position of the intended instruction in the vehicle; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; determine the execution screen of the intended instruction among the at least one vehicle-mounted screen; and then use the arbitration decision tree to perform secondary control on the intended instruction Arbitration, query the dependency of the execution process of the intention instruction on the vehicle-mounted screen in the vehicle, and obtain the secondary arbitration result; finally, use the arbitration decision tree to perform three-level arbitration on the intention instruction, and search for the target application in the acquired applications of the execution screen; if the target application is not available in the acquired applications of the execution screen, download the target application from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, use the default application as the target application, thereby obtaining a three-level arbitration result; use the first-level arbitration result (the judgment result of whether the intention instruction is executable and the execution screen determined to execute the intention instruction), the second-level arbitration result and the third-level arbitration result as the final arbitration result. Combined with the final arbitration result, execute the intention instruction.

[0139] It should be noted that the third-level arbitration results include the target application.

[0140] In an embodiment of the present application, if the arbitration result includes a first-level arbitration result, a second-level arbitration result, and a third-level arbitration result, then in combination with the final arbitration result, the process of executing the intention instruction includes: when the first-level arbitration result includes executing the intention instruction, the second-level arbitration result includes relying on the vehicle screen, and the third-level arbitration result includes the target application, the target application can be searched in the execution screen, and when the target application is found, the intention instruction is executed based on the target application.

[0141] In an embodiment of the present application, after receiving voice interaction information on a vehicle and identifying the intended instruction in the voice interaction information, the intended instruction can be used to match a target script corresponding to the intended instruction in a pre-stored script; an arbitration node is determined based on the target script, and then based on the arbitration node, a judgment is made in a pre-built arbitration decision tree as to whether the intended instruction is executable in the current scenario mode; if the intended instruction is executable, the sound source position of the intended instruction in the vehicle is determined; according to the preset control authority of the sound source position, at least one vehicle-mounted screen that can be controlled by the sound source position is determined; among the at least one vehicle-mounted screen, the execution screen of the intended instruction is determined; and the arbitration node is used to determine the execution screen of the intended instruction. The decision tree performs secondary arbitration on the intention instruction, queries the dependency of the execution process of the intention instruction on the on-board screen in the vehicle, and obtains a secondary arbitration result; if the secondary arbitration result is dependency on the on-board screen, the execution screen is unlocked, and the intention instruction is executed through the execution screen; finally, the arbitration decision tree is used to perform tertiary arbitration on the intention instruction, and the target application is searched for in the acquired applications of the execution screen; if the target application is not found in the acquired applications of the execution screen, the target application is downloaded from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, the default application is used as the target application.

[0142] In some embodiments, after determining whether the intended instruction is executable in the current scenario mode, if it is determined that the intended instruction is not executable in the current scenario mode, a prompt message indicating that the intended instruction corresponding to the voice interaction information is not executed is output.

[0143] In an embodiment of the present application, if it is determined that the execution of the intention instruction is not supported in the current mode, the rejection information and related prompts are directly returned (i.e., the prompt information of not executing the intention instruction corresponding to the voice interaction information is output), thereby eliminating the subsequent judgment steps and reducing signaling overhead.

[0144] Faced with an ever-increasing volume of voice commands, the aforementioned strategy structure allows for a more convenient entry into the arbitration world than the previously used, step-by-step approach. Furthermore, from a maintenance perspective, the arbitration world, layered with if-else statements, is like a stacked tower. Through the interplay of factors such as the width and strength of the underlying bricks, the distribution and balance of gravity, and the cohesion between the bricks, it is possible to remove or add one brick at a time without causing the entire structure to collapse. The same applies to arbitration logic, and this structure enables scalability, flexibility, and security.

[0145] Furthermore, as a specific implementation of the method shown in FIG1 and FIG2 , this embodiment provides a voice arbitration device, as shown in FIG3 , which includes: a receiving part 301 , a matching part 302 , an arbitration part 303 and an execution part 304 .

[0146] The receiving part 301 is configured to receive voice interaction information and identify the intended instruction in the voice interaction information;

[0147] The matching portion 302 is configured to use the intention instruction to match a target script corresponding to the intention instruction in a pre-stored script; the pre-stored script is a pre-written script program, the script program includes an arbitration node for determining an arbitration type, and is used to determine the corresponding arbitration node according to different intentions; the target script is used to determine the arbitration node to be performed on the intention instruction;

[0148] The arbitration section 303 is configured to perform arbitration step by step in a pre-built arbitration decision tree based on the arbitration nodes determined by the target scenario to obtain an arbitration result; the decision tree includes n levels, where n is greater than or equal to 1, and each level includes a number of arbitration nodes;

[0149] The execution part 304 is configured to execute the intended instruction in combination with the arbitration result.

[0150] In a specific application scenario, the arbitration part 303 is further configured to determine whether the intended instruction is executable in the current scenario mode based on the arbitration decision tree; if the intended instruction is executable, determine the sound source position of the intended instruction; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen that can be controlled by the sound source position; and among the at least one vehicle-mounted screen, determine the execution screen of the intended instruction.

[0151] In a specific application scenario, the arbitration part 303 is further configured to use the arbitration decision tree to perform secondary arbitration on the intention instruction, query the dependency of the execution process of the intention instruction on the on-board screen, and obtain a secondary arbitration result; wherein, the secondary arbitration result includes dependency on the on-board screen and non-dependence on the on-board screen.

[0152] In a specific application scenario, the arbitration part 303 is further configured to unlock the execution screen and execute the intended instruction through the execution screen when the secondary arbitration result is dependent on the vehicle-mounted screen; and execute the intended instruction when the secondary arbitration result is not dependent on the vehicle-mounted screen and the execution screen is not unlocked.

[0153] In a specific application scenario, the arbitration part 303 is further configured to perform three-level arbitration on the intention instruction using the arbitration decision tree, and search for the target application in the acquired applications of the execution screen; if the target application is not available in the acquired applications of the execution screen, the target application is downloaded from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, the default application is used as the target application.

[0154] In a specific application scenario, the arbitration part 303 is further configured to use the arbitration decision tree to perform a first-level arbitration on the intended instruction and determine a first-level arbitration result; the first-level arbitration result includes determining whether the intended instruction is executable and determining an execution screen for the intended instruction;

[0155] If the primary arbitration result is that the intention instruction is executable, performing secondary arbitration on the intention instruction to determine the secondary arbitration result; the secondary arbitration result includes determining the dependency relationship between the intention instruction and the vehicle-mounted screen;

[0156] After the secondary arbitration result is determined, a tertiary arbitration is performed on the intention instruction to determine a tertiary arbitration result; the tertiary arbitration result includes determining a target application for executing the intention instruction.

[0157] Based on the above-mentioned method shown in Figures 1 and 2, this embodiment also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a first processor, it implements the above-mentioned method shown in Figures 1 and 2 (i.e., the voice arbitration method of the first aspect).

[0158] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.

[0159] Based on the above-mentioned method shown in Figures 1 and 2, and the virtual device embodiment shown in Figure 3, in order to achieve the above-mentioned purpose, the embodiment of the present application also provides an electronic device that can be configured on a computer side, a vehicle side, etc., and the device includes a storage medium and a first processor; the storage medium is used to store a computer program; the first processor is used to execute the computer program to implement the above-mentioned method shown in Figures 1 and 2 (i.e., the voice arbitration method of the first aspect).

[0160] Based on the above electronic device, an embodiment of the present application further provides a vehicle, which may specifically include: the device shown in FIG3 or the above electronic device. The vehicle may specifically be a new energy vehicle or a traditional vehicle.

[0161] Optionally, the physical device may further include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a Wi-Fi module, and the like. The user interface may include a display, an input unit such as a keyboard, and the like. Optional user interfaces may also include a USB interface, a card reader interface, and the like. The network interface may optionally include a standard wired interface, a wireless interface (such as a Wi-Fi interface), and the like.

[0162] Those skilled in the art will understand that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different component arrangements.

[0163] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the physical device, supporting the execution of information processing programs and other software and / or programs. The network communication module is used to enable communication between components within the storage medium, as well as with other hardware and software within the physical information processing device.

[0164] Through the description of the above implementation methods, those skilled in the art can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform, or by hardware. Applying the solution of this embodiment, first receive voice interaction information and identify the intention instruction, use the intention instruction to match the target script corresponding to the intention instruction in the pre-stored script, the script here is a pre-written script program, the script program contains an arbitration node for determining the arbitration type, which is used to determine the corresponding arbitration node according to different intentions; the target script is used to determine the arbitration node to be performed on the intention instruction. Then, based on the arbitration node determined by the target script, step-by-step arbitration is performed in the pre-constructed arbitration decision tree to obtain an arbitration result; wherein the decision tree includes n levels, n is greater than or equal to 1, and each level includes a number of arbitration nodes. Finally, based on the obtained arbitration result, the intention instruction is executed. Compared with related technologies, this application clarifies the multi-level judgment logic by setting up an arbitration decision tree, and then through multiple pre-set scripts, it can determine the corresponding arbitration node to be performed for each intention instruction. Finally, based on the arbitration node, the arbitration logic to be performed can be found in the arbitration decision tree, which optimizes the existing voice arbitration architecture and arbitration logic, and improves the current voice arbitration method that does not set the judgment sequence logic, has poor arbitration flexibility and is not conducive to maintenance.

[0165] Furthermore, this embodiment provides a voice arbitration device, which includes a receiving part 301 , an arbitration part 303 and an execution part 304 .

[0166] The receiving part 301 is configured to receive voice interaction information on the vehicle and identify the intended instruction in the voice interaction information;

[0167] The arbitration part 303 is configured to arbitrate the intention instruction step by step to obtain an arbitration result;

[0168] The execution part 304 is configured to execute the intention command in the vehicle based on the arbitration result.

[0169] In a specific application scenario, the arbitration part 303 is further configured to determine whether the intended instruction is executable in the current scenario mode; if the intended instruction is executable, determine the sound source position of the intended instruction in the vehicle; according to the preset control authority of the sound source position, determine at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source position; and among the at least one vehicle-mounted screen, determine the execution screen of the intended instruction.

[0170] In a specific application scenario, the arbitration part 303 is further configured to perform secondary arbitration on the intention instruction, query the dependency of the execution process of the intention instruction on the on-board screen in the vehicle, and obtain a secondary arbitration result; wherein, the secondary arbitration result includes dependency on the on-board screen in the vehicle and non-dependence on the on-board screen in the vehicle.

[0171] In a specific application scenario, the arbitration part 303 is further configured to unlock the execution screen and execute the intended instruction through the execution screen when the secondary arbitration result is dependent on the vehicle-mounted screen; and to execute the intended instruction without unlocking the execution screen when the secondary arbitration result is not dependent on the vehicle-mounted screen.

[0172] In a specific application scenario, the arbitration part 303 is further configured to perform three-level arbitration on the intention instruction, searching for the target application in the acquired applications of the execution screen; if the target application is not available in the acquired applications of the execution screen, downloading the target application from the application source of the execution screen; if the target application cannot be found in the application source of the execution screen, using the default application as the target application.

[0173] In a specific application scenario, the arbitration part 303 is further configured to output a prompt message of not executing the intention instruction corresponding to the voice interaction information when it is determined that the intention instruction is not executable in the current scenario mode.

[0174] Accordingly, this embodiment further provides a computer-readable storage medium storing a computer program, which implements the voice arbitration method of the second aspect when executed by the second processor.

[0175] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.

[0176] Based on the voice arbitration method of the second aspect described above, and the corresponding virtual device embodiment, in order to achieve the above-mentioned purpose, an embodiment of the present application further provides an electronic device that can be configured on a computer side, a vehicle side, etc., and the device includes a storage medium and a second processor; the storage medium is used to store a computer program; the second processor is used to execute the computer program to implement the voice arbitration method of the second aspect described above.

[0177] Based on the above electronic device, an embodiment of the present application further provides a vehicle, which may include: the above voice arbitration device or the above electronic device. The vehicle may be a new energy vehicle or a traditional vehicle.

[0178] Optionally, the physical device may further include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a Wi-Fi module, and the like. The user interface may include a display, an input unit such as a keyboard, and the like. Optional user interfaces may also include a USB interface, a card reader interface, and the like. The network interface may optionally include a standard wired interface, a wireless interface (such as a Wi-Fi interface), and the like.

[0179] Those skilled in the art will understand that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different component arrangements.

[0180] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the physical device, supporting the execution of information processing programs and other software and / or programs. The network communication module is used to enable communication between components within the storage medium, as well as with other hardware and software within the physical information processing device.

[0181] Through the description of the above implementation methods, those skilled in the art can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform, or by hardware. Applying the solution of this embodiment, firstly, voice interaction information is received and the intention instruction is identified, and the intention instruction is arbitrated step by step to obtain the arbitration result; finally, based on the obtained arbitration result, the intention instruction is executed. Compared with the related art, the present application optimizes the existing voice arbitration architecture and arbitration logic by performing multi-level judgment logic on the intention instruction, thereby improving the problem that the current voice arbitration method does not have a judgment sequence logic, has poor arbitration flexibility and is not conducive to maintenance.

[0182] It should be noted that, in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprises" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a..." do not exclude the presence of other identical elements in the process, method, article or device that includes the elements.

[0183] The above description is only a specific embodiment of the present application, which enables those skilled in the art to understand or implement the present application. Various modifications to these embodiments will be obvious to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features of the present application.

[0184] The above description and accompanying drawings sufficiently illustrate the embodiments of the present application to enable those skilled in the art to practice them. Other embodiments may include structural, logical, electrical, process, and other changes. The embodiments represent only possible variations. Unless expressly required, individual components and functions are optional, and the order of operations may vary. Portions and features of some embodiments may be included in or replaced with portions and features of other embodiments. As used in this application, the term "and / or" means including any and all possible combinations of one or more associated listed items. In addition, when used in this application, the term "comprise" and its variations "comprises" and / or comprising refer to the presence of the stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or groups thereof. Without further limitation, an element defined by the phrase "comprises a..." does not exclude the presence of other identical elements in the process, method, or device that includes the element. In this document, each embodiment may focus on the differences from other embodiments, and similar parts between the embodiments can be referenced. For methods, devices, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can be referenced in the description of the method part.

[0185] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the embodiments of the present application. The technicians will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0186] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are merely illustrative. For example, the division of the units can be merely a logical functional division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, the functional units in the embodiments of the present application may be integrated into a processing unit, or each unit may exist physically alone, or two or more units may be integrated into one unit.

[0187] The flowcharts and block diagrams in the accompanying drawings show the possible architecture, functions and operations of the systems, methods and computer program products according to the embodiments of the present application. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the part of the module, program segment or code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowcharts and block diagrams in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in an order different from that disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified function or action, or may be implemented by a combination of dedicated hardware and computer instructions. Industrial Applicability

[0188] The embodiments of the present application provide a voice arbitration method, device, electronic device and vehicle. The voice arbitration method includes: receiving voice interaction information and identifying the intention instruction in the voice interaction information; using the intention instruction to match the target script corresponding to the intention instruction in the pre-stored script; based on the arbitration node determined by the target script, performing step-by-step arbitration in the pre-built arbitration decision tree to obtain the arbitration result; and executing the intention instruction in combination with the arbitration result. The above method is adopted to implement the scheme, and the multi-level judgment logic is clarified by setting the arbitration decision tree. Then, through the pre-set multiple scripts, the corresponding arbitration node to be performed can be determined for each intention instruction. Finally, based on the arbitration node, the arbitration logic to be performed can be found in the arbitration decision tree. The existing voice arbitration architecture and arbitration logic are optimized to improve the current voice arbitration method. The problem that the judgment sequence logic is not set, the arbitration flexibility is poor and it is not conducive to maintenance is improved.

Claims

1. A voice arbitration method, comprising: Receiving voice interaction information and identifying intended instructions in the voice interaction information; Using the intention instruction, matching the target script corresponding to the intention instruction in the pre-stored scripts; The pre-stored script is a pre-written script program, which includes an arbitration node for determining the arbitration type, and is used to determine the corresponding arbitration node according to different intentions; The target script is used to determine the arbitration node to be performed on the intention instruction; Based on the arbitration nodes determined by the target scenario, arbitration is performed step by step in a pre-built arbitration decision tree to obtain an arbitration result; The decision tree includes n levels, where n is greater than or equal to 1, and each level includes a number of arbitration nodes; The intention instruction is executed in combination with the arbitration result.

2. The method according to claim 1, wherein The arbitration nodes determined based on the target scenario are arbitrated step by step in a pre-built arbitration decision tree to obtain an arbitration result, including: Determine whether the intended instruction is executable in the current scenario mode based on the arbitration decision tree; If the intended instruction is executable, determining a sound source position of the intended instruction; According to the preset control authority of the sound source position, determining at least one vehicle-mounted screen that can be controlled by the sound source position; In the at least one in-vehicle screen, an execution screen for the intended instruction is determined.

3. The method according to claim 2, wherein: After determining the execution screen of the intended instruction, the method further includes: Performing secondary arbitration on the intention instruction using the arbitration decision tree, querying the dependency of the execution process of the intention instruction on the vehicle screen, and obtaining a secondary arbitration result; The secondary arbitration results include reliance on the vehicle-mounted screen and non-reliance on the vehicle-mounted screen.

4. The method according to claim 3, wherein: After obtaining the secondary arbitration result, the method further includes: If the secondary arbitration result is to rely on the vehicle screen, unlock the execution screen and execute the intended instruction through the execution screen; When the secondary arbitration result is not dependent on the vehicle screen and the execution screen is not unlocked, the intention instruction is executed.

5. The method according to claim 3 or 4, wherein: After obtaining the secondary arbitration result, the method further includes: Performing three-level arbitration on the intended instruction using the arbitration decision tree, and searching for a target application in the acquired applications on the execution screen; If the target application is not present in the acquired applications on the execution screen, downloading the target application from the application program source on the execution screen; In the case that the target application cannot be found in the application source of the execution screen, a default application is used as the target application.

6. The method according to any one of claims 1 to 5, wherein: The pre-built arbitration decision tree includes three arbitration levels; The arbitration nodes determined based on the target scenario are arbitrated step by step in a pre-built arbitration decision tree to obtain an arbitration result, including: Using the arbitration decision tree, performing a first-level arbitration on the intended instruction and determining a first-level arbitration result; the first-level arbitration result includes determining whether the intended instruction is executable and determining an execution screen for the intended instruction; If the primary arbitration result is that the intention instruction is executable, performing secondary arbitration on the intention instruction to determine the secondary arbitration result; the secondary arbitration result includes determining the dependency relationship between the intention instruction and the vehicle-mounted screen; After the secondary arbitration result is determined, a tertiary arbitration is performed on the intention instruction to determine a tertiary arbitration result; the tertiary arbitration result includes determining a target application for executing the intention instruction.

7. A voice arbitration method, comprising: Receiving voice interaction information from the vehicle and identifying intended instructions in the voice interaction information; Arbitrating the intention instruction step by step to obtain an arbitration result; Based on the arbitration result, the intention command is executed in the vehicle.

8. The method according to claim 7, wherein: The step-by-step arbitration of the intention instruction to obtain an arbitration result includes: Determine whether the intended instruction is executable in the current scenario mode; If the intended instruction is executable, determining a sound source position of the intended instruction in the vehicle; According to the preset control authority of the sound source position, determining at least one vehicle-mounted screen in the vehicle that can be controlled by the sound source position; In the at least one in-vehicle screen, an execution screen for the intended instruction is determined.

9. The method according to claim 8, wherein After determining the execution screen of the intended instruction, the method further includes: Performing secondary arbitration on the intention instruction, querying the dependency of the execution process of the intention instruction on the vehicle-mounted screen in the vehicle, and obtaining a secondary arbitration result; The secondary arbitration result includes depending on the on-board screen in the vehicle and not depending on the on-board screen in the vehicle.

10. The method according to claim 9, wherein: After obtaining the secondary arbitration result, the method further includes: If the secondary arbitration result is to rely on the vehicle screen, unlock the execution screen and execute the intended instruction through the execution screen; When the secondary arbitration result is not dependent on the vehicle-mounted screen, the intention instruction is executed, and the execution screen is not unlocked.

11. The method according to claim 9 or 10, wherein: After obtaining the secondary arbitration result, the method further includes: Performing three-level arbitration on the intended instruction and searching for a target application in the acquired applications on the execution screen; If the target application is not present in the acquired applications on the execution screen, downloading the target application from the application program source on the execution screen; In the case that the target application cannot be found in the application source of the execution screen, a default application is used as the target application.

12. The method according to claim 8, characterized in that After determining whether the intended instruction is executable in the current scenario mode, the method further includes: When it is determined that the intended instruction is not executable in the current scenario mode, a prompt message indicating that the intended instruction corresponding to the voice interaction information is not executed is output.

13. A voice arbitration device, comprising: A receiving part is configured to receive voice interaction information and identify intended instructions in the voice interaction information; A matching part is configured to use the intention instruction to match a target script corresponding to the intention instruction in pre-stored scripts; The pre-stored script is a pre-written script program, which includes an arbitration node for determining the arbitration type, and is used to determine the corresponding arbitration node according to different intentions; The target script is used to determine the arbitration node to be performed on the intention instruction; The arbitration part is configured to perform arbitration step by step in a pre-built arbitration decision tree based on the arbitration nodes determined by the target scenario to obtain an arbitration result; The decision tree includes n levels, where n is greater than or equal to 1, and each level includes a number of arbitration nodes; The execution part is configured to execute the intention instruction in combination with the arbitration result.

14. A computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a first processor, the computer program implements the method according to any one of claims 1 to 6; when the computer program is executed by a second processor, the computer program implements the method according to any one of claims 7 to 12.

15. An electronic device comprising a storage medium, a first processor, a second processor, a computer program stored on the storage medium and executable on the first processor, and a computer program stored on the storage medium and executable on the second processor, wherein the first processor implements the method of any one of claims 1 to 6 when executing the computer program, and the second processor implements the method of any one of claims 7 to 12 when executing the computer program.

16. A vehicle comprising: The apparatus according to claim 13, or the electronic device according to claim 15.

Images