Voice instruction distribution method, device and equipment, readable storage medium and product

Abstract

The invention provides a voice instruction distribution method and device, equipment, a readable storage medium and a product, and relates to the field of data processing, in particular to the technical field of voice. According to the specific implementation scheme, a voice instruction sent by a user is acquired, and associated data of the voice instruction is determined; determining a plurality of application vertical classes supported by the terminal equipment based on the identification information associated with the terminal equipment; in response to the fact that the terminal equipment supports the target application vertical class, adopting a preset encapsulation protocol to perform encapsulation operation on the associated data, and sending the encapsulated associated data to the terminal equipment; and obtaining a processing result sent by the terminal equipment. By setting the encapsulation protocol, the issuing of voice instructions of three-party applications in different terminal devices can be realized, so that the processing of the voice instructions is realized. An independent packaging protocol and a calling interface do not need to be set for each application vertical class supported by terminal equipment of different brands.

Description

Technical Field

[0001] The present disclosure relates to voice technology in data processing, and particularly to a voice command distribution method, apparatus, device, readable storage medium, and product. Background Art

[0002] To enhance the driving experience of users, a preset client is provided in related technologies. When a user connects a terminal device in a vehicle, various preset service contents can be shared to the vehicle side through the preset client for display. In addition, the user can also issue a voice command, and the preset client distributes the voice command to implement the function associated with the voice command.

[0003] However, the vertical categories supported by different terminal devices are different. For example, some terminal devices do not support the navigation function, and some terminal devices do not support the music function, etc. How to implement the voice command distribution and processing for different terminal devices has become an urgent problem to be solved. Summary of the Invention

[0004] The present disclosure provides a voice command distribution method, apparatus, device, readable storage medium, and product for voice command distribution of different terminal devices.

[0005] According to a first aspect of the present disclosure, a voice command distribution method is provided, which is applied to a preset client disposed in a terminal device, and includes:

[0006] Obtain a voice command issued by a user, and determine associated data of the voice command, where the associated data includes a target application vertical category, intention information, and associated parameters associated with the voice command;

[0007] Determine multiple application vertical categories supported by the terminal device based on identification information associated with the terminal device;

[0008] In response to the terminal device supporting the target application vertical category, encapsulate the associated data by a preset first instance using a preset encapsulation protocol, and send the encapsulated associated data to the terminal device, where the terminal device is configured to perform a parsing operation on the encapsulated associated data based on the encapsulation protocol, send the associated data to a third-party application corresponding to the target application vertical category for data processing, and obtain a processing result;

[0009] Obtain the processing result sent by the terminal device.

[0010] According to a second aspect of the present disclosure, a voice command distribution method is provided, which is applied to a terminal device and includes:

[0011] Obtain the encapsulated associated data sent by the preset client;

[0012] Perform a decoding operation on the encapsulated associated data through a preset encapsulation protocol to obtain the associated data, where the associated data includes a target application vertical category, intent information, and associated parameters associated with the voice command issued by the user;

[0013] Send the intent information and the associated parameters to a third-party application under the target application vertical category, so that the third-party application performs data processing based on the intent information and the associated parameters to obtain a processing result;

[0014] Send the processing result to the preset client.

[0015] According to a third aspect of the present disclosure, there is provided a voice command distribution device, which is applied to a preset client, and the preset client is set in a terminal device, including:

[0016] An acquisition module, configured to acquire a voice command issued by a user and determine the associated data of the voice command, where the associated data includes a target application vertical category, intent information, and associated parameters associated with the voice command;

[0017] A determination module, configured to determine multiple application vertical categories supported by the terminal device based on the identification information associated with the terminal device;

[0018] A processing module, configured to, in response to the terminal device supporting the target application vertical category, perform an encapsulation operation on the associated data by using a preset first instance through a preset encapsulation protocol, and send the encapsulated associated data to the terminal device, where the terminal device is configured to perform an analysis operation on the encapsulated associated data based on the encapsulation protocol, send the associated data to a third-party application corresponding to the target application vertical category for data processing, and obtain a processing result;

[0019] A communication module, configured to acquire the processing result sent by the terminal device.

[0020] According to a fourth aspect of the present disclosure, there is provided a voice command distribution device, which is applied to a terminal device and includes:

[0021] A data acquisition module, configured to acquire the encapsulated associated data sent by a preset client;

[0022] A decoding module, configured to perform a decoding operation on the encapsulated associated data through a preset encapsulation protocol to obtain the associated data, where the associated data includes a target application vertical category, intent information, and associated parameters associated with the voice command issued by the user;

[0023] A calling module, configured to send the intent information and associated parameters to a third-party application under the target application vertical category, so that the third-party application processes data based on the intent information and associated parameters to obtain a processing result;

[0024] A sending module, configured to send the processing result to the preset client.

[0025] According to a fifth aspect of the present disclosure, there is provided an electronic device, including:

[0026] At least one processor; and

[0027] A memory communicatively connected to the at least one processor; wherein,

[0028] The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in the first aspect or the second aspect.

[0029] According to a sixth aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method described in the first aspect or the second aspect.

[0030] According to a seventh aspect of the present disclosure, there is provided a computer program product, the computer program product including: a computer program, the computer program is stored in a readable storage medium, and at least one processor of an electronic device can read the computer program from the readable storage medium, and the at least one processor executes the computer program so that the electronic device executes the method described in the first aspect or the second aspect.

[0031] The technology according to the present disclosure can adapt to different brands of terminal devices to implement the distribution and processing of voice commands.

[0032] It should be understood that the content described in this part is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it used to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] The drawings are used to better understand the solution and do not constitute a limitation to the present disclosure. Among them:

[0034] Figure 1 is a system architecture diagram based on the present disclosure;

[0035] Figure 2 is a flow chart of the voice command distribution method provided by an embodiment of the present disclosure;

[0036] Figure 3 Schematic diagram of an application scenario provided by an embodiment of the present disclosure;

[0037] Figure 4 Schematic flowchart of a voice command distribution method provided by an embodiment of the present disclosure;

[0038] Figure 5 Schematic diagram of the structure of a voice command distribution device provided by an embodiment of the present disclosure;

[0039] Figure 6 Schematic diagram of the structure of a voice command distribution device provided by an embodiment of the present disclosure;

[0040] Figure 7 Schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Detailed implementation manners

[0041] The following describes exemplary embodiments of the present disclosure with reference to the accompanying drawings. Various details of the embodiments of the present disclosure are included to facilitate understanding, and they should be considered merely exemplary. Therefore, those of ordinary skill in the art should recognize that various changes and modifications can be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, descriptions of well-known functions and structures are omitted below for clarity and conciseness.

[0042] The present disclosure provides a voice command distribution method, device, equipment, readable storage medium and product, which are applied to voice technology in data processing to achieve the effect of adapting to terminal devices of different brands to realize the distribution and processing of voice commands.

[0043] In order to enable users to enjoy a safer and more convenient in-vehicle experience during driving, related technologies provide a preset client for users. Users can install the preset client on the terminal device side and the vehicle side respectively. Thus, after the user connects the mobile phone in the vehicle, the service content pre-aggregated on the terminal device side can be sent to the vehicle side for display.

[0044] Optionally, the user can also wake up the voice function of the preset client by a preset wake-up word. Thus, after the user issues a voice command, the voice command can be sent to the preset client through the cloud server. The preset client can distribute the voice command to a third-party application in the terminal device that matches the intent of the voice command, so that the third-party application executes the voice command and feeds back the processing result.

[0045] However, since the command configurations associated with the voice assistants of terminal devices of different brands are different, and the functions that can be realized by terminal devices of different brands are also different. Therefore, it is difficult for the preset client to adapt to a variety of different models of terminal devices and cannot accurately realize the accurate distribution and execution of voice commands.

[0046] In the process of solving the above technical problems, the inventors found through research that in order to adapt to different models of terminal devices and accurately implement the accurate issuance and execution of voice commands, a general encapsulation protocol can be configured. The preset client can perform the encapsulation and issuance operations of voice command association information through this encapsulation protocol. After the terminal device obtains the encapsulated data, it can decode the data and call third-party applications based on this encapsulation protocol.

[0047] By setting this encapsulation protocol, it is possible to achieve information interaction with terminal devices of multiple brands and call third-party applications in terminal devices of different brands. There is no need to set a separate protocol and interface for each third-party application under each brand.

[0048] For example, after obtaining a voice command, the voice command can be parsed to determine the target application vertical category, intent information, and associated parameters corresponding to the voice command. When it is determined that the terminal device supports the target application vertical category, the voice command instance can perform the encapsulation and issuance operations of voice command association information based on this encapsulation protocol.

[0049] In the technical solution of the present disclosure, the collection, storage, use, processing, transmission, provision, and disclosure of the user's personal information and other processes all comply with the provisions of relevant laws and regulations and do not violate public order and good customs.

[0050] To enable readers to more deeply understand the implementation principle of the present disclosure, the following Figures 1-7 is used to further refine the embodiments of the present disclosure.

[0051] Figure 1 is the system architecture diagram based on the present disclosure. As Figure 1 shown, the system architecture based on the present disclosure at least includes a terminal device 11, a cloud server 12, and a vehicle 13. Among them, the preset client is pre-installed in both the terminal device 11 and the vehicle 13. The terminal device 11 can be communicatively connected to the cloud server 12 and the vehicle 13 respectively.

[0052] Based on the above system architecture, after the preset client obtains the connection request sent by the terminal device 11, it can establish a communication connection with the terminal device 11. The preset client and the terminal device 11 can share a proxy object. Therefore, data transmission and third-party application calls can be performed based on this proxy object in the future. Among them, the proxy object can respectively include at least one call interface for voice command processing and at least one data processing method for voice command processing in the preset client, and at least one call interface for voice command processing and at least one data processing method for voice command processing in the terminal device.

[0053] After receiving the voice command initiated by the user, the cloud server 12 can parse the voice command to determine the associated data of the voice command. And the associated data is sent to the preset client in the terminal device 11. When it is determined that the terminal device supports the target application vertical category, the preset client can encapsulate and send the associated data of the voice command using a preset encapsulation protocol. The terminal device can call a third-party application based on the associated data for data processing, obtain a processing result, and send the processing result to the preset client. After obtaining the processing result, the processing result can be sent to the in-vehicle device in the vehicle 13 for display.

[0054] Figure 2 It is a schematic flowchart of the voice command distribution method provided by the embodiments of the present disclosure. As Figure 2 shown, it is applied to a preset client, and the preset client is set in a terminal device. There are also third-party applications associated with multiple application vertical categories set in the terminal device. The method includes:

[0055] Step 201, obtain the voice command issued by the user, and determine the associated data of the voice command. The associated data includes the target application vertical category associated with the voice command and intent data.

[0056] The execution subject of this embodiment is a voice command distribution device, and the voice command distribution device can be coupled in the preset client. The preset client can be set in the terminal device. And there are also third-party applications associated with multiple application vertical categories set in the terminal device. The preset client can integrate resource content and transmit it to the client on the vehicle side for display, and moreover, it can support the processing of voice commands.

[0057] In this embodiment, the user can control the terminal device to execute corresponding functions by issuing a voice command. For example, the user can control the terminal device to play music, perform navigation operations, inquire about the weather, etc. by issuing a voice command.

[0058] In response to the user's voice command, a third-party application in the terminal device can be called for processing the voice command.

[0059] Optionally, the voice command issued by the user can be obtained. In order to accurately implement the processing of the voice command, data analysis can be further performed on the voice command to determine the associated data of the voice command. The associated data includes the target application vertical category associated with the voice command and intent data. Among them, the intent data includes at least intent information and associated parameters.

[0060] Taking a practical application as an example, the voice command issued by the user can be "Navigate to Place A". The voice command can be parsed to determine that the application vertical category corresponding to the voice command is the map vertical category, the intent information corresponding to the voice command is the navigation intent, and the associated parameter of the voice command can be Place A.

[0061] By determining the associated data of the voice command, it is possible to more accurately determine the third-party application to be called and enable the third-party application to process the voice command more accurately.

[0062] Step 202: Determine multiple application vertical categories supported by the terminal device based on the identification information associated with the terminal device.

[0063] In this embodiment, the application vertical categories supported by terminal devices of different brands are different. For example, the terminal device of Brand A does not support applications in the map vertical category, the terminal device of Brand B does not support applications in the music vertical category, and the terminal device of Brand C does not support applications for weather query, etc.

[0064] It can be understood that if the terminal device supports the function of the target application vertical category, the terminal device can call the application software under the target application vertical category to process the voice command. Otherwise, the terminal device cannot process the voice command.

[0065] Therefore, in order to accurately implement the processing of voice commands, it is also possible to determine multiple application vertical categories supported by the terminal device based on the identification information associated with the terminal device. The identification information of the terminal device can be sent to the preset client when the terminal device establishes a communication connection with the preset client, or can also be actively acquired by the preset client. The present disclosure does not limit this.

[0066] Step 203: In response to the terminal device supporting the target application vertical category, perform an encapsulation operation on the associated data using a preset encapsulation protocol, and send the encapsulated associated data to the terminal device. The terminal device is used to perform a decoding operation on the encapsulated associated data based on the encapsulation protocol, and send the intent data to the third-party application corresponding to the target application vertical category, so that the third-party application performs data processing based on the intent data to obtain a processing result.

[0067] In this embodiment, in order to be compatible with terminal devices of different brands and implement the operation of issuing voice commands, a general encapsulation protocol can be set. When it is determined that the terminal device supports the function of the target application vertical category, the encapsulation and issuing operations of the associated data of the voice command are performed through this encapsulation protocol.

[0068] Optionally, the encapsulation protocol includes the data content to be encapsulated and the data format. The data content includes the target application vertical category and the intent data. Therefore, the preset client can encapsulate the associated data of the voice command according to the encapsulation protocol.

[0069] Further, after determining the multiple application vertical categories supported by the terminal device, if it is determined that the target application vertical category is included in the multiple application vertical categories, the associated data can be encapsulated by using a preset encapsulation protocol, and the encapsulated associated data can be sent to the terminal device.

[0070] As an implementable manner, a first instance can be preset, and based on this first instance, the encapsulation and distribution operations of the associated data of the voice command can be performed. Among them, the first instance can be a set of a series of functions. After determining that the terminal device supports the target application vertical category, the first instance can encapsulate the associated data according to the encapsulation protocol. And the encapsulated associated data is sent to the terminal device through a preset call interface. The call interface can be sent by the terminal device to the preset client after establishing a communication connection with the preset client.

[0071] The encapsulation protocol can also be preset in the terminal device. Therefore, after the terminal device obtains the encapsulated associated data, it can parse the encapsulated associated data based on the encapsulation protocol, send the associated data to the third-party application corresponding to the target application vertical category for data processing, and obtain a processing result.

[0072] Based on the above method, it is possible to accurately perform the encapsulation and distribution operations of the associated data of the voice command based on the application vertical categories supported by different terminal devices. When the application vertical categories supported by the terminal device change, that is, when the supported application vertical categories are updated, the voice command can be processed based on the updated vertical categories. There is no need to change the encapsulation protocol and the call interface.

[0073] Step 204, obtain the processing result sent by the terminal device.

[0074] In this embodiment, after the terminal device calls a third-party application to process the voice command and obtains a processing result, the processing result can be sent to the preset client. The preset client can obtain the processing result.

[0075] The voice command distribution method provided in this embodiment sets a general encapsulation protocol in advance, so that when it is determined that the terminal device supports the target application vertical related to the voice command, the encapsulation protocol can be used to encapsulate the associated data of the voice command, and the encapsulated associated data can be sent to the terminal device through a preset call interface. The terminal device can also decode the encapsulated associated data based on the encapsulation protocol. And call a third-party application to process the voice command based on the decoding result. By setting this encapsulation protocol, it is possible to send voice commands to third-party applications in different terminal devices to implement the processing of voice commands. There is no need to set a separate encapsulation protocol and call interface for each application vertical supported by different brand terminal devices.

[0076] Optionally, based on any of the above embodiments, step 202 includes:

[0077] Obtain a preset mapping list, where the mapping list includes multiple sets of mapping data pairs associated with different preset devices, and the mapping data pairs include the identification information of the preset device and the application vertical supported by the preset device;

[0078] Determine multiple application verticals supported by the terminal device in the preset mapping list based on the identification information associated with the terminal device.

[0079] In this embodiment, there are often differences in the functions that different brand terminal devices can support. For example, some terminal devices do not support the navigation function, some terminal devices do not support the weather query function, and some terminal devices do not support the music playback function, etc.

[0080] Therefore, in order to enable the preset client to adapt to all brand terminal devices, a mapping list can be set in advance. The mapping list includes multiple sets of mapping data pairs associated with different preset devices, and the mapping data pairs include the identification information of the preset device and the application vertical supported by the preset device.

[0081] Furthermore, the mapping list can be obtained. After obtaining the identification information associated with the terminal device, the mapping data pair that matches the identification information can be determined in the mapping list, and the application vertical corresponding to the preset device association in the mapping data pair is determined as the multiple application verticals supported by the terminal device.

[0082] Optionally, the mapping list can be maintained in the cloud server or in the preset client, and the present disclosure does not limit this.

[0083] The voice command distribution method provided in this embodiment can accurately determine multiple application vertical categories supported by the terminal device in the mapping list based on the identification information of the terminal device by pre - constructing a mapping list and storing multiple application vertical categories associated with multiple preset devices in the mapping list. Furthermore, the encapsulation and distribution operations of voice commands can be accurately implemented.

[0084] Further, based on any of the above - mentioned embodiments, the method further includes:

[0085] Obtain the update information corresponding to the mapping list, where the update information includes the identification information of the preset device and the update content of the application vertical categories supported by the preset device;

[0086] Perform an update operation on the application vertical categories supported by the preset device based on the update information.

[0087] In this embodiment, the application vertical categories supported by the terminal device may change. For example, when the terminal device is released, it does not support applications in the map vertical category. As the system of the terminal device is updated, the terminal device can support applications in the map vertical category. At this time, the terminal device can process voice commands related to the map vertical category.

[0088] Therefore, in order to accurately implement the distribution and processing of voice commands, the mapping list can be updated in a timely manner. The update information corresponding to the mapping list can be obtained, and the update information includes the identification information of the preset device and the update content of the application vertical categories supported by the preset device. Among them, the update content can be a new vertical category, a deleted vertical category, a changed vertical category, etc., and the present disclosure does not limit this.

[0089] Therefore, after obtaining the update information, an update operation can be performed on the application vertical categories supported by the preset device based on the update information. Thus, after obtaining a voice command subsequently, it can be determined whether the target application vertical category is included in all the vertical categories supported by the terminal device based on the updated mapping list. Furthermore, the voice command can be processed based on the detection result.

[0090] The voice command distribution method provided in this embodiment can determine whether the target application vertical category is included in all the vertical categories supported by the terminal device based on the updated mapping list by performing update operations on the vertical categories supported by different - brand terminal devices in the mapping list. Furthermore, the processing of voice commands can be more accurate.

[0091] Optionally, based on any of the above - mentioned embodiments, step 201 includes:

[0092] Obtain the voice command issued by the user, and send the voice command to the cloud server. The cloud server is used to convert the voice command into text content and identify the associated data of the voice command based on the text content.

[0093] Obtain the associated data sent by the cloud server.

[0094] In this embodiment, the preset client can recognize the user's voice. When it is determined that the user issues a voice command, the voice command can be sent to the cloud server for data analysis operations.

[0095] Optionally, after obtaining the voice command, the cloud server can convert the voice command into text content based on a preset speech-to-text algorithm, and can identify the target application vertical category, intent information, and associated data associated with the voice command based on the text content. And it can be sent to the preset client.

[0096] Taking an actual application as an example, the text content corresponding to the voice command can be to play the songs of singer A. After analyzing the text content, it can be determined that the target application vertical category is the music vertical category, the intent information can be the play intent, and the associated parameter can be the identification information of singer A. Therefore, after encapsulating and sending the associated data to the terminal device, the terminal device can parse the encapsulated data and send the play intent and the information of singer A to the third-party application in the music vertical category. The third-party application can search for the songs of singer A and perform play operations. Or, the songs of singer A can be fed back to the preset client so that the client can call the in-vehicle device to perform play operations.

[0097] The voice command distribution method provided in this embodiment can improve the accuracy of data parsing by using the cloud server to parse the voice command. And it can reduce the occupied content of the preset client and save the computing resources of the terminal device.

[0098] Optionally, based on any of the above embodiments, step 201 includes:

[0099] Obtain the wake-up word issued by the user. If the wake-up word is consistent with the wake-up word associated with the preset client, determine the voice information within a preset duration after the wake-up word as the voice command.

[0100] In this embodiment, the terminal device may preset a voice assistant, and the voice assistant may be associated with a first wake-up word. And the preset client may also be associated with a wake-up word, and the wake-up words of the two may be different. When the user issues a voice command, in order to accurately determine which voice command processing channel to use for processing the voice command, it is also necessary to perform wake-up word recognition operations.

[0101] Optionally, a wake-up word uttered by the user can be obtained. In response to the wake-up word being consistent with the wake-up word associated with the preset client, at this time, the preset client can be used to process the voice command. At this time, the voice information within a preset duration after the wake-up word can be determined as the voice command.

[0102] The voice command distribution method provided in this embodiment can accurately process the voice command by using the voice command processing channel that matches the wake-up word through identifying the wake-up word of the user.

[0103] Optionally, based on any of the above embodiments, the method further includes:

[0104] In response to the connection request sent by the terminal device, establish a communication connection with the terminal device through the target interface definition language, where the target interface definition language is used to implement inter-process communication.

[0105] Send a first proxy object to the terminal device, where the first proxy object includes at least one call interface for voice command processing and at least one data processing method for voice command processing within the preset client;

[0106] Obtain a second proxy object sent by the terminal device, where the second proxy object includes at least one call interface for voice command processing and at least one data processing method for voice command processing within the terminal device.

[0107] In this embodiment, after obtaining the connection request sent by the terminal device, a communication connection can be established with the terminal device through the target interface definition language, where the target interface definition language is used to implement inter-process communication. For example, the target interface definition language can be an interface definition language (Android Interface Definition Language, abbreviated as AIDL) used to implement inter-process communication (IPC) in the Android system. AIDL allows applications between different processes to exchange data and communicate through the defined interfaces, mainly for the interaction between the server and the client.

[0108] Furthermore, after establishing the communication connection, perform a sharing operation of proxy objects with the terminal device. The proxy objects include a first proxy object and a second proxy object. The first proxy object includes at least one call interface for voice command processing and at least one data processing method for voice command processing within the preset client; the second proxy object includes at least one call interface for voice command processing and at least one data processing method for voice command processing within the terminal device.

[0109] Taking practical applications as examples, the data processing method includes, but is not limited to, any method related to voice command processing, such as a method for content transmission, a method for recording the progress of data transmission, a method for connection binding, etc.

[0110] The voice command distribution method provided in this embodiment can call an application associated with a voice command in a terminal device and perform data backhaul, etc. by performing mutual transmission operations of proxy objects with the terminal device after establishing a communication connection with the terminal device.

[0111] Optionally, based on any of the above embodiments, after step 202, it further includes:

[0112] In response to the terminal device not supporting the target application vertical category, determine whether any of the multiple preset functions built in the preset client can process the associated data;

[0113] If there is, process the associated data based on the preset function built in the preset client to obtain a processing result;

[0114] If not, play a preset prompt content, where the preset prompt content is used to prompt the user to change to other voice commands, and / or, the preset prompt content is used to prompt the user that the target function associated with the voice command cannot be executed.

[0115] In this embodiment, after determining the multiple application vertical categories supported by the terminal device, it is possible that the target application vertical category is not included in the multiple application vertical categories. At this time, there is no third-party application in the terminal device that can process the voice command.

[0116] In order to be able to process all voice commands, the voice command can also be processed as a fallback to obtain a processing result.

[0117] Some preset functions can be pre-set in the preset client. For example, content can be retrieved on the Internet based on the associated data of the voice command through this preset function, or the weather can be queried through this preset function, or music can be retrieved and played based on the associated data of the voice command through this preset function, etc.

[0118] Therefore, when it is determined that there is no third-party application in the terminal device that can process the voice command, it can be determined whether any of the preset functions in the preset client can process the associated data. If there is, process the associated data based on the preset function to obtain a processing result.

[0119] Conversely, if it is determined that there is no preset function in the preset client that can process the associated data, at this time, the preset prompt content can be played. The preset prompt content is used to prompt the user to replace with other voice commands, and / or the preset prompt content is used to prompt that the target function associated with the voice command cannot be executed. Thus, it can enable the user to more intuitively understand the implementation situation of the current voice command.

[0120] As an implementable way, a second instance can be set in advance. Among them, the second instance can call the preset function in the preset client to implement the processing of the voice command. Or, the second instance can also control the display of the prompt information. Through the second instance, the voice commands of the application vertical categories not supported by the terminal device are handled in a fallback manner to obtain the processing result.

[0121] Therefore, when it is determined that there is any preset function in the preset client that can process the associated data, the second instance can call the preset function to process the associated data and obtain the processing result.

[0122] Conversely, if it is determined that there is no preset function in the preset client that can process the associated data, at this time, the second instance can play the preset prompt content. The preset prompt content is used to prompt the user to replace with other voice commands, and / or the preset prompt content is used to prompt that the target function associated with the voice command cannot be executed.

[0123] By setting the second instance in advance, it can enable the processing of voice commands when the terminal device does not support the target application vertical category. Therefore, through the combination of the first instance and the second instance, the processing of all voice commands can be realized.

[0124] Figure 3 Schematic diagram of the application scenario provided by the embodiments of the present disclosure, as Figure 3 shown, after obtaining the associated data of the voice command sent by the cloud server 31, based on whether the terminal device supports the target application vertical category associated with the voice command. If it supports, the first instance is hit, and the distribution operation 32 of the voice command can be performed based on the first instance. Conversely, if it is determined that the terminal device does not support the target application vertical category, the second instance is hit, and the fallback processing 33 can be performed based on the second instance.

[0125] The voice command distribution method provided by this embodiment, by calling the preset function in the preset client to process the associated data of the voice command when it is determined that the terminal device does not support the target application vertical category, or playing the preset prompt content, can realize the processing of all voice commands regardless of whether the terminal device supports the target application vertical category.

[0126] Optionally, the preset client is communicatively connected to the vehicle-mounted device, so that the interconnection between the terminal device and the vehicle side can be realized. The method further includes:

[0127] Sending the processing result to the vehicle-mounted device through a preset call interface, so that the vehicle-mounted device presents the processing result.

[0128] In this embodiment, the client of the preset client can be preset on both the terminal device side and the vehicle side. Thus, the content collected on the terminal device side can be sent to the vehicle side for display.

[0129] After encapsulating the associated data of the voice command based on the first instance, it can be distributed to the terminal device, so that the terminal device calls a third-party application under the target application vertical category for data processing to obtain a processing result. The preset client can obtain the processing result sent by the terminal device. Or, after the second instance processes the voice command by calling a preset function, a processing result can also be obtained.

[0130] Optionally, the processing result can be displayed in the client on the terminal device side. The processing result can also be sent to the vehicle-mounted device on the vehicle side through a preset call interface, so that the vehicle-mounted device presents the processing result. Among them, this call interface is different from the call interface for the preset client to interact with the terminal device.

[0131] Taking an actual application as an example, if the voice command sent by the cloud server is "navigate from point A to point B", the target application vertical category associated with this voice command can be the map vertical category. The intent information associated with this voice command can be the navigation intent. The associated parameters of this voice command can be point A and point B.

[0132] After determining that the terminal device supports the functions of the map vertical category, the voice command can be encapsulated and distributed through the first instance, and the associated data of the voice command is encapsulated and sent to the terminal device. The terminal device can call the navigation application under the map vertical category to process the voice command.

[0133] For example, the navigation application can plan a route based on the intent information and associated parameters associated with the voice command, generate a navigation result, and feedback it to the preset client. The preset client can send the navigation result to the vehicle-mounted device on the vehicle side through a preset call interface. Among them, the vehicle-mounted device includes a vehicle-mounted screen and a vehicle-mounted audio. Therefore, the route planned by the navigation application can be displayed on the vehicle side, and the navigation voice associated with this route can be broadcast through the vehicle-mounted audio.

[0134] The voice command distribution method provided in this embodiment can transmit the processing result to the vehicle side for content presentation by pre - establishing a communication connection between the preset client on the terminal device side and the preset client on the vehicle side, ensuring that users can enjoy a safer and more convenient in - vehicle experience during driving.

[0135] Figure 4 It is a schematic flowchart of the voice command distribution method provided in an embodiment of the present disclosure, which is applied to a terminal device. There are also multiple third - party applications associated with application vertical categories set in the terminal device, such as Figure 4 As shown, the method includes:

[0136] Step 401: Obtain the encapsulated associated data sent by the preset client.

[0137] Step 402: Decode the encapsulated associated data through a preset encapsulation protocol to obtain the associated data, where the associated data includes the target application vertical category associated with the voice command issued by the user and the intent data.

[0138] Step 403: Send the intent data to the third - party application under the target application vertical category, so that the third - party application processes the data based on the intent data to obtain a processing result.

[0139] Step 404: Send the processing result to the preset client.

[0140] The execution subject of this embodiment is a voice command distribution device. The voice command distribution device can be coupled to the terminal device. A preset client is set in the terminal device, and the terminal device can communicate with the preset client.

[0141] In this embodiment, the terminal device and the preset client can use a preset encapsulation protocol for content transmission. After the preset client obtains the voice command issued by the user, when it determines that the target application vertical category associated with the voice command is supported in the terminal device, it can use a preset first instance to perform the encapsulation operation of the associated data of the voice command through this encapsulation protocol, and send the encapsulated associated data to the terminal device.

[0142] Correspondingly, the terminal device can obtain the encapsulated associated data. Since the encapsulation protocol is also preset in the terminal device, the terminal device can decode the encapsulated associated data based on this encapsulation protocol to obtain the associated data, where the associated data includes the target application vertical category associated with the voice command issued by the user and the intent data. Among them, the intent data includes intent information and associated parameters.

[0143] Therefore, the terminal device can send the intent information and associated parameters to the third-party application under the target application vertical. The third-party application can process the data based on the intent information and associated parameters to obtain a processing result, and can feedback the processing result to the preset client.

[0144] Taking an actual application as an example, the text content corresponding to the voice command can be to play the songs of singer A. Therefore, the target application vertical is the music vertical, the intent information can be the play intent, and the associated parameter can be the identification information of singer A. After the terminal device decodes the associated data, it can send the play intent and the information of singer A to the third-party application in the music vertical. The third-party application can search for the songs of singer A and perform a play operation. Or, it can feedback the songs of singer A to the preset client so that the client can call the in-vehicle device to perform a play operation.

[0145] The voice command distribution method provided in this embodiment can decode the encapsulated data sent by the preset client based on the pre-set general encapsulation protocol to obtain the associated data of the voice command. And the associated data can be transmitted to the third-party application under the target application vertical for data processing to obtain a processing result. The preset client can interact with the voice command associated data of the terminal devices of different brands based on the general encapsulation protocol. There is no need to set communication protocols and call interfaces for each third-party application in each application vertical in the terminal devices of each brand. It can realize the distribution of voice commands to the third-party applications in different terminal devices to implement the processing of voice commands.

[0146] Figure 5 FIG. is a schematic structural diagram of a voice command distribution device provided in an embodiment of the present disclosure, which is applied to a preset client. The preset client is set in a terminal device, and multiple third-party applications associated with application verticals are also set in the terminal device, such as Figure 5As shown in the figure, the device includes: an acquisition module 51, a determination module 52, a processing module 53, and a communication module 54. Among them, the acquisition module 51 is used to acquire a voice instruction issued by a user, determine associated data of the voice instruction, and the associated data includes a target application vertical category associated with the voice instruction and intention data. The determination module 52 is used to determine multiple application vertical categories supported by the terminal device based on identification information associated with the terminal device. The processing module 53 is used to, in response to the terminal device supporting the target application vertical category, perform an encapsulation operation on the associated data using a preset encapsulation protocol, and send the encapsulated associated data to the terminal device. The terminal device is used to perform a decoding operation on the encapsulated associated data based on the encapsulation protocol, and send the intention data to a third-party application corresponding to the target application vertical category, so that the third-party application performs data processing based on the intention data to obtain a processing result. The communication module 54 is used to acquire the processing result sent by the terminal device.

[0147] Further, based on any of the above embodiments, the determination module includes: an acquisition unit, configured to acquire a preset mapping list, where the mapping list includes multiple groups of mapping data pairs associated with different preset devices, and the mapping data pairs include identification information of the preset device and application vertical categories supported by the preset device. A determination unit, configured to determine multiple application vertical categories supported by the terminal device in the preset mapping list based on the identification information associated with the terminal device.

[0148] Further, based on any of the above embodiments, the device further includes: an acquisition module, configured to acquire update information corresponding to the mapping list, where the update information includes identification information of a preset device and update content of application vertical categories supported by the preset device. An update module, configured to perform an update operation on application vertical categories supported by the preset device based on the update information.

[0149] Further, based on any of the above embodiments, the encapsulation protocol includes data content to be encapsulated and a data format, and the data content includes a target application vertical category associated with the voice instruction and intention data.

[0150] Further, based on any of the above embodiments, the acquisition module includes: a transmission unit, configured to acquire a voice instruction issued by the user, send the voice instruction to a cloud server, and the cloud server is configured to convert the voice instruction into text content and identify associated data of the voice instruction based on the text content. An acquisition unit, configured to acquire the associated data sent by the cloud server.

[0151] Further, based on any of the above embodiments, the obtaining module includes: an obtaining unit, configured to obtain a wake-up word issued by the user, and if the wake-up word is consistent with the wake-up word associated with the preset client, determine the voice information within a preset duration after the wake-up word as the voice command.

[0152] Further, based on any of the above embodiments, the device further includes: a establishing module, configured to establish a communication connection with the terminal device through a target interface definition language in response to a connection request sent by the terminal device, where the target interface definition language is used to implement inter-process communication. A sharing module, configured to send a first proxy object to the terminal device, where the first proxy object includes at least one call interface for voice command processing and at least one data processing method for voice command processing within the preset client; obtain a second proxy object sent by the terminal device, where the second proxy object includes at least one call interface for voice command processing and at least one data processing method for voice command processing within the terminal device.

[0153] Further, based on any of the above embodiments, the device further includes: a processing module, configured to determine whether any of the multiple preset functions built in the preset client can perform data processing on the associated data in response to the terminal device not supporting the target application vertical category. A first execution module, configured to, if any exists, perform data processing on the associated data based on the preset function built in the preset client to obtain a processing result; a second execution module, configured to, if none exists, play a preset prompt content, where the preset prompt content is used to prompt the user to replace with other voice commands, and / or, the preset prompt content is used to prompt the user that the target function associated with the voice command cannot be executed.

[0154] Further, based on any of the above embodiments, the preset client is communicatively connected to a vehicle-mounted device, and the device further includes: a transmission module, configured to send the processing result to the vehicle-mounted device through a preset call interface, so that the vehicle-mounted device presents the processing result.

[0155] Figure 6 The structure diagram of the voice command distribution device provided by the embodiments of the present disclosure is applied to a terminal device, and multiple third-party applications associated with application vertical categories are further set in the terminal device, such as Figure 6As shown in the figure, the device includes: a data acquisition module 61, a decoding module 62, a calling module 63, and a sending module 64. Among them, the data acquisition module 61 is used to acquire the encapsulated associated data sent by a preset client. The decoding module 62 is used to perform a decoding operation on the encapsulated associated data through a preset encapsulation protocol to obtain the associated data, and the associated data includes the target application vertical category associated with the voice instruction issued by the user and the intent data. The calling module 63 is used to send the intent data to a third-party application under the target application vertical category, so that the third-party application processes data based on the intent data to obtain a processing result. The sending module 64 is used to send the processing result to the preset client.

[0156] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0157] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, including:

[0158] at least one processor; and

[0159] a memory communicatively connected to the at least one processor; wherein,

[0160] the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in any of the above embodiments.

[0161] According to an embodiment of the present disclosure, the present disclosure also provides a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method described in any of the above embodiments.

[0162] According to an embodiment of the present disclosure, the present disclosure also provides a computer program product, which includes: a computer program. The computer program is stored in a readable storage medium, and at least one processor of the electronic device can read the computer program from the readable storage medium, and the at least one processor executes the computer program so that the electronic device executes the solution provided in any of the above embodiments.

[0163] Figure 7Schematic structural diagram of the electronic device provided by the embodiments of the present disclosure. The electronic device 700 is intended to represent various forms of digital computers, such as, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as, personal digital processors, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0164] As Figure 7 shown, the device 700 includes a computing unit 701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 702 or a computer program loaded from a storage unit 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0165] Multiple components in the device 700 are connected to the I / O interface 705, including: an input unit 706, such as a keyboard, a mouse, etc.; an output unit 707, such as various types of displays, speakers, etc.; a storage unit 708, such as a magnetic disk, an optical disc, etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0166] The computing unit 701 can be various general-purpose and / or special-purpose processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, a digital signal processor (DSP), and any suitable processor, controller, microcontroller, etc. The computing unit 701 executes the various methods and processes described above, such as the voice instruction distribution method. For example, in some embodiments, the voice instruction distribution method can be implemented as a computer software program tangibly embodied in a machine-readable medium, such as the storage unit 708. In some embodiments, part or all of the computer program can be loaded and / or installed onto the device 700 via the ROM 702 and / or the communication unit 709. When the computer program is loaded into the RAM 703 and executed by the computing unit 701, one or more steps of the voice instruction distribution method described above can be executed. Alternatively, in other embodiments, the computing unit 701 can be configured to execute the voice instruction distribution method by any other suitable means (e.g., by means of firmware).

[0167] The various embodiments of the systems and techniques described above in this document can be implemented in digital electronic circuitry, integrated circuit systems, field-programmable gate arrays (FPGA), application-specific integrated circuits (ASIC), application-specific standard products (ASSP), system-on-a-chip systems (SOC), complex programmable logic devices (CPLD), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a dedicated or general-purpose programmable processor, and can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit the data and instructions to the storage system, the at least one input device, and the at least one output device.

[0168] The program code for implementing the methods of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, such that when the program codes are executed by the processor or controller, the functions / operations specified in the flowcharts and / or block diagrams are implemented. The program codes can be executed entirely on the machine, partially on the machine, as an independent software package partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0169] In the context of this disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0170] In order to provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which the user can provide input to the computer. Other kinds of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, speech input, or tactile input).

[0171] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which the user can interact with an implementation of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.

[0172] A computer system may include a client and a server. The client and the server are generally far from each other and usually interact through a communication network. The relationship between the client and the server is generated by computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or a cloud host, which is a host product in the cloud computing service system, and solves the defects of difficult management and weak business scalability existing in traditional physical hosts and VPS services ("Virtual Private Server", or simply "VPS"). The server may also be a server of a distributed system, or a server combined with a blockchain.

[0173] It should be understood that various forms of the processes shown above can be used, steps can be reordered, added or deleted. For example, the steps described in the present disclosure can be executed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved, and no limitations are imposed herein.

[0174] The above specific embodiments do not constitute a limitation on the protection scope of the present disclosure. Those skilled in the art should understand that various modifications, combinations, sub-combinations, and substitutions can be made according to design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principle of the present disclosure shall be included within the protection scope of the present disclosure.

Claims

1. A voice command distribution method, applied to a preset client, wherein the preset client is set in a terminal device, and the terminal device is also provided with a plurality of third-party applications associated with application vertical categories, including: Acquire a voice command issued by a user, and determine associated data of the voice command, wherein the associated data includes a target application vertical category and intent data associated with the voice command; Determine multiple application vertical categories supported by the terminal device based on identification information associated with the terminal device; In response to the terminal device supporting the target application vertical category, a preset encapsulation protocol is used to encapsulate the associated data, and the encapsulated associated data is sent to the terminal device, the terminal device is used to decode the encapsulated associated data based on the encapsulation protocol, and send the intent data to the third-party application corresponding to the target application vertical category, so that the third-party application performs data processing based on the intent data to obtain a processing result; Obtain the processing result sent by the terminal device.

2. The method according to claim 1, wherein: The determining, based on the identification information associated with the terminal device, a plurality of application vertical categories supported by the terminal device includes: Obtain a preset mapping list, wherein the mapping list includes mapping data pairs associated with multiple groups of different preset devices, and the mapping data pairs include identification information of the preset devices and application vertical categories supported by the preset devices; Based on the identification information associated with the terminal device, multiple application vertical categories supported by the terminal device are determined in a preset mapping list.

3. The method according to claim 2, further comprising: Obtain update information corresponding to the mapping list, wherein the update information includes identification information of the preset device and update content of the application vertical category supported by the preset device; Based on the update information, an update operation is performed on the application vertical category supported by the preset device.

4. According to the method described in claim 1, the encapsulation protocol includes the data content and data format to be encapsulated, and the data content includes the target application vertical category and intent data associated with the voice command.

5. According to the method of claim 1, the acquiring of the voice command issued by the user and determining the associated data of the voice command comprises: Acquire the voice command issued by the user, and send the voice command to a cloud server, wherein the cloud server is used to convert the voice command into text content and identify the associated data of the voice command based on the text content; The associated data sent by the cloud server is obtained.

6. The method according to claim 1, wherein obtaining a voice command issued by a user comprises: A wake-up word issued by the user is obtained, and in response to the wake-up word being consistent with a wake-up word associated with the preset client, voice information within a preset time length after the wake-up word is determined as the voice command.

7. The method according to claim 1, further comprising: In response to a connection request sent by the terminal device, establishing a communication connection with the terminal device through a target interface definition language, wherein the target interface definition language is used to implement inter-process communication; Sending a first proxy object to the terminal device, wherein the first proxy object includes at least one calling interface for voice command processing in the preset client and at least one data processing method for voice command processing; A second proxy object sent by the terminal device is obtained, where the second proxy object includes at least one calling interface for voice command processing in the terminal device and at least one data processing method for voice command processing.

8. The method according to claim 1, after determining the multiple application vertical categories supported by the terminal device in a preset mapping list based on the identification information associated with the terminal device, further comprising: In response to the terminal device not supporting the target application vertical category, determining whether any preset function among a plurality of preset functions built into the preset client can perform data processing on the associated data; If so, performing data processing on the associated data based on a preset function built into the preset client to obtain a processing result; If not present, a preset prompt content is played, wherein the preset prompt content is used to prompt the user to change to other voice commands, and / or the preset prompt content is used to prompt the user that the target function associated with the voice command cannot be executed.

9. The method according to claim 1 or 8, wherein the preset client is in communication connection with the vehicle-mounted device, and the method further comprises: The processing result is sent to the vehicle-mounted device through a preset calling interface, so that the vehicle-mounted device presents the processing result.

10. A voice command distribution method, applied to a terminal device, wherein the terminal device is also provided with a plurality of third-party applications associated with application vertical categories, including: Get the encapsulated associated data sent by the preset client; The encapsulated associated data is decoded by a preset encapsulation protocol to obtain the associated data, wherein the associated data includes a target application vertical category and intent data associated with the voice command issued by the user; Sending the intent data to a third-party application under the target application vertical category, so that the third-party application performs data processing based on the intent data to obtain a processing result; The processing result is sent to the preset client.

11. A voice command distribution device, applied to a preset client, the preset client is set in a terminal device, and the terminal device is also provided with a plurality of third-party applications associated with application vertical categories, including: An acquisition module, used to acquire a voice command issued by a user and determine associated data of the voice command, wherein the associated data includes a target application vertical category and intent data associated with the voice command; A determination module, configured to determine a plurality of application vertical categories supported by the terminal device based on identification information associated with the terminal device; a processing module, configured to, in response to the terminal device supporting the target application vertical category, encapsulate the associated data using a preset encapsulation protocol, and send the encapsulated associated data to the terminal device, wherein the terminal device is configured to decode the encapsulated associated data based on the encapsulation protocol, and send the intent data to a third-party application corresponding to the target application vertical category, so that the third-party application performs data processing based on the intent data to obtain a processing result; A communication module is used to obtain the processing result sent by the terminal device.

12. A voice command distribution device, applied to a terminal device, wherein the terminal device is also provided with a plurality of third-party applications associated with application vertical categories, including: A data acquisition module is used to acquire the encapsulated associated data sent by a preset client; A decoding module, used to decode the encapsulated associated data through a preset encapsulation protocol to obtain the associated data, wherein the associated data includes a target application vertical category and intent data associated with the voice command issued by the user; A calling module, used to send the intent data to a third-party application under the target application vertical category, so that the third-party application performs data processing based on the intent data to obtain a processing result; The sending module is used to send the processing result to the preset client.

13. An electronic device, comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 9 or 10.

14. A non-transitory computer-readable storage medium storing computer instructions, wherein: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-9 or 10.

15. A computer program product, comprising a computer program, which, when executed by a processor, implements the steps of the method according to any one of claims 1 to 9 or 10.

Images