Voice control method and intelligent terminal

Abstract

Embodiments of the present application provide a voice control method and a smart device. The method is applied to a smart terminal, at least two application programs (APPs) are installed on the smart terminal, each APP supports one or more types of voice instructions, and the method comprises: receiving a voice instruction; determining that the type of the voice instruction is a first type; determining a target APP from the at least two APPs installed on the smart terminal, the target APP supporting the voice instruction of the first type; and executing the voice instruction by using the target APP. The embodiments of the present application can realize voice interaction across APPs, simplify user operation, and improve the operation efficiency of users.

Description

[0001] This application is a divisional application. The original application has the application number 202080098739.4 and the original application date is March 30, 2020. The entire contents of the original application are incorporated herein by reference. Technical Field

[0002] This application relates to the field of intelligent voice technology, and in particular to a voice control method and an intelligent terminal. Background Technology

[0003] In current set-top boxes (STBs), whether it's the television operator system (TVOS) or other systems, the integration of smart voice is basically achieved by each application (APP) integrating third-party voice services to support voice interaction. In other words, each APP independently integrates its own voice interaction technology. This approach can only achieve voice interaction within the APP itself, and cannot achieve cross-app voice interaction.

[0004] For example, a live streaming app is currently running, and users can control it to switch channels using its integrated voice function. However, if a user wants to watch on-demand programs, they cannot directly use voice interaction; they need to manually run the on-demand app and then control its voice function. Therefore, how to achieve cross-app voice interaction is a problem that urgently needs to be solved. Summary of the Invention

[0005] This application discloses a voice control method and a smart terminal that enables cross-app voice interaction, simplifies user operations, and improves user efficiency.

[0006] The first aspect of this application discloses a voice control method applied to a smart terminal. At least two application software (APPs) are installed on the smart terminal, and each APP supports one or more types of voice commands. The method includes: receiving a voice command; determining that the voice command is of a first type; determining a target APP that supports the first type of voice command from among the at least two APPs installed on the smart terminal; and executing the voice command using the target APP.

[0007] In this embodiment, voice commands are categorized, and then an app on the smart terminal that supports that type of voice command is found. This app is then used to execute the voice command. Implementing this embodiment integrates the apps installed on the smart terminal, enabling cross-app voice interaction. This simplifies user operations and improves user efficiency.

[0008] In one possible implementation, before receiving the voice command, the method further includes: declaring, in the configuration files of at least two apps installed on the smart terminal, the types of one or more voice commands supported by each app.

[0009] This application embodiment can declare the types of voice commands supported by the APP in the APP's configuration file. After receiving a voice command, the smart terminal can determine the APP that can execute the voice command by looking up the voice command types declared in the configuration files of each APP, and then dispatch the voice command to the APP that can execute the voice command, thereby realizing voice control.

[0010] In one possible implementation, determining the target APP that supports the first type of voice commands from at least two APPs installed on the smart terminal includes: determining M first APPs that support the first type of voice commands from at least two APPs installed on the smart terminal; M is a positive integer; and determining the target APP from the M first APPs.

[0011] This application provides a method for determining a target APP. When there are multiple APPs that support the first type of voice commands, the smart terminal can further determine the APP that will ultimately execute the voice command from among these multiple APPs to achieve voice control.

[0012] In one possible implementation, determining the target APP that supports the first type of voice commands from at least two APPs installed on the smart terminal includes: determining whether there is a corresponding default APP for the first type of voice commands; the default APP being the APP that is the default to process the first type of voice commands; and if there is a corresponding default APP for the first type of voice commands, determining the default APP corresponding to the first type of voice commands as the target APP.

[0013] It is possible that the default app is set by the manufacturer at the factory. The manufacturer can determine the default app corresponding to various types of voice commands by statistically analyzing the operating habits of a large number of users.

[0014] It's possible that the default app can be set by the user according to their own usage habits.

[0015] This application provides another way to determine the target APP. First, it checks whether there is a corresponding default APP for the first type of voice command. If there is a default APP, the default APP is used first to process the voice command to ensure that the final dispatch result of the command meets the user's needs.

[0016] In one possible implementation, determining the target app that supports the first type of voice command from at least two apps installed on the smart terminal includes: determining whether there is a corresponding default app for the first type of voice command; the default app is the app that defaults to processing the first type of voice command; if there is no corresponding default app for the first type of voice command, determining M first apps that support the first type of voice command from at least two apps installed on the smart terminal; M is a positive integer; and determining the target app from the M first apps.

[0017] This application provides another method for determining the target app: when there is no corresponding default app for the first type of voice command, the target app is selected from multiple first apps. This application comprehensively considers how voice commands should be dispatched in various situations, improving the accuracy of command dispatch and enhancing the user experience.

[0018] In one possible implementation, the target app is the most frequently used app among the apps that support the first type of voice commands, or the target app is the app whose last usage time is closest to the current time among the apps that support the first type of voice commands.

[0019] When there are multiple apps that support the first type of voice commands, this application embodiment can select the most frequently used app or the app that the user has recently used to execute the voice commands, taking into account the user's operating habits, ensuring the accuracy of command dispatch, and improving the user experience.

[0020] In one possible implementation, if the APP currently running on the aforementioned smart terminal supports the first type of voice commands, then the target APP is the currently running APP.

[0021] In this embodiment, if the currently running app supports the first type of voice commands, then the currently running app is selected as the target app. Implementing this embodiment allows for prioritizing the currently running app as the target app, and by combining this with the current application scenario, voice commands can be dispatched, improving the accuracy of voice command dispatch and enhancing the user experience.

[0022] In one possible implementation, the APP supporting the first type of voice commands is obtained based on a command relationship table, which includes at least two APPs installed on the smart terminal and the voice command types supported by each of the at least two APPs.

[0023] This application embodiment can record the voice command types supported by each APP installed on the smart terminal in a command relationship table. When a certain type of voice command is received, the smart terminal can look up the command relationship table to determine which APPs support that type of voice command, and then dispatch the command to achieve voice control, thereby reducing user operations and improving the efficiency of voice control.

[0024] In one possible implementation, the APP currently running on the aforementioned smart terminal is not the aforementioned target APP; before executing the aforementioned voice command using the aforementioned target APP, the aforementioned method further includes: running the aforementioned target APP.

[0025] This application embodiment can run the target APP before executing voice commands, reducing the steps of manual operation by the user to run the APP and improving the efficiency of voice control.

[0026] In one possible implementation, before running the target app, the method further includes stopping the currently running app.

[0027] In this embodiment, the currently running app is switched before the target app is used to execute voice commands, reducing the need for users to manually switch apps and improving the efficiency of voice control.

[0028] In one possible implementation, the command relationship table also includes the installation paths of the at least two apps respectively; running the target app includes: searching the command relationship table, determining the installation path of the target app, and running the target app according to the installation path of the target app.

[0029] In this embodiment, the installation paths of each APP can be recorded in a command relationship table. The smart terminal can run the target APP by searching for the installation path recorded in the command relationship table, so as to realize intelligent voice control without the need for manual operation by the user and improve operation efficiency.

[0030] Secondly, embodiments of this application provide a smart device for use on a smart terminal. At least two application software (APP) programs are installed on the smart terminal, and each APP supports one or more types of voice commands. The smart device includes: a receiving module for receiving voice commands; a first determining module for determining that the voice command is of a first type; a second determining module for determining a target APP that supports the first type of voice command from among the at least two APP programs installed on the smart terminal; and the target APP for executing the voice command.

[0031] In one possible implementation, the first determining module is an intelligent voice component, and the second determining module is an application management component.

[0032] In one possible implementation, the smart device further includes a declaration module for declaring, in the configuration files of at least two apps installed on the aforementioned smart terminal, the types of one or more voice commands supported by each app.

[0033] In one possible implementation, the second determining module includes the following functions: determining M first apps that support the first type of voice commands from at least two apps installed on the smart terminal; M is a positive integer; and determining a target app from the M first apps.

[0034] In one possible implementation, the second APP determination module is specifically used to: determine whether there is a corresponding default APP for the first type of voice command; the default APP is the APP that is used to process the first type of voice command by default; and if there is a corresponding default APP for the first type of voice command, determine the default APP corresponding to the first type of voice command as the target APP.

[0035] In one possible implementation, the second determining module is specifically used to: determine whether there is a corresponding default APP for the first type of voice command; the default APP is the APP that is the default to process the first type of voice command; if there is no corresponding default APP for the first type of voice command, determine M first APPs that support the first type of voice command from at least two APPs installed on the smart terminal; M is a positive integer; determine the target APP from the M first APPs.

[0036] In one possible implementation, the target app is the most frequently used app among the apps that support the first type of voice commands, or the target app is the app whose last usage time is closest to the current time among the apps that support the first type of voice commands.

[0037] In one possible implementation, if the APP currently running on the aforementioned smart terminal supports the first type of voice commands, the target APP is the currently running APP.

[0038] In one possible implementation, the APP supporting the first type of voice commands is obtained based on a command relationship table, which includes at least two APPs installed on the smart terminal and the voice command types supported by each of the at least two APPs.

[0039] In one possible implementation, the APP currently running on the aforementioned smart terminal is not the target APP; the aforementioned smart device further includes: a running module for running the target APP.

[0040] In one possible implementation, the aforementioned runtime module is a television virtual machine (TVM).

[0041] In one possible implementation, the smart device further includes a stop-run module, used to stop the currently running APP before the running module runs the target APP.

[0042] In one possible implementation, the command relationship table also includes the installation paths of the at least two apps respectively; the running module is specifically used to: search the command relationship table, determine the installation path of the target app, and run the target app according to the installation path of the target app.

[0043] Thirdly, embodiments of this application provide a smart device for use in a smart terminal. At least two application software programs (APPs) are installed on the smart terminal, each APP supporting one or more types of voice commands. The smart device includes a processor and a transmission interface. The processor is configured to invoke software instructions stored in a memory to execute: receiving a voice command through the transmission interface; determining the type of the voice command as a first type; determining a target APP that supports the first type of voice command from among the at least two APPs installed on the smart terminal; and executing the voice command using the target APP.

[0044] In one possible implementation, before receiving the voice command, the processor further performs the following: declaring, in the configuration files of at least two apps installed on the smart terminal, the types of one or more voice commands supported by each app.

[0045] In one possible implementation, when the processor executes the process of determining a target app that supports the first type of voice commands from at least two apps installed on the smart terminal, it specifically performs the following: determining M first apps that support the first type of voice commands from at least two apps installed on the smart terminal; where M is a positive integer; and determining the target app from the M first apps.

[0046] In one possible implementation, when the processor determines a target app that supports the first type of voice commands from at least two apps installed on the smart terminal, it specifically performs the following: determining whether there is a corresponding default app for the first type of voice commands; the default app is the app that defaults to processing the first type of voice commands; and if there is a corresponding default app for the first type of voice commands, determining the default app corresponding to the first type of voice commands as the target app.

[0047] In one possible implementation, when the processor executes the process of determining a target app that supports the first type of voice command from at least two apps installed on the smart terminal, it specifically performs the following steps: determining whether there is a corresponding default app for the first type of voice command; the default app is the app that defaults to processing the first type of voice command; if there is no corresponding default app for the first type of voice command, determining M first apps that support the first type of voice command from at least two apps installed on the smart terminal; M is a positive integer; and determining the target app from the M first apps.

[0048] In one possible implementation, the target app is the most frequently used app among the apps that support the first type of voice commands, or the target app is the app whose last usage time is closest to the current time among the apps that support the first type of voice commands.

[0049] In one possible implementation, if the APP currently running on the aforementioned smart terminal supports the first type of voice commands, then the target APP is the currently running APP.

[0050] In one possible implementation, the APP supporting the first type of voice commands is obtained based on a command relationship table, which includes at least two APPs installed on the smart terminal and the voice command types supported by each of the at least two APPs.

[0051] In one possible implementation, the APP currently running on the aforementioned smart terminal is not the aforementioned target APP; before the processor executes the aforementioned voice command using the aforementioned target APP, the processor also executes: running the aforementioned target APP.

[0052] In one possible implementation, before the processor runs the target app, the processor also performs the following: stops running the currently running app.

[0053] In one possible implementation, the command relationship table also includes the installation paths of the at least two apps respectively; when the processor runs the target app, it specifically performs the following: searches the command relationship table, determines the installation path of the target app, and runs the target app according to the installation path of the target app.

[0054] Fourthly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on a computer or processor, cause the computer or processor to perform the voice control method provided by the first aspect or any possible implementation thereof of the embodiments of this application.

[0055] Fifthly, embodiments of this application provide a computer program product containing instructions that, when the computer program product is run on a computer or processor, cause the computer or processor to execute the voice control method provided by the first aspect or any possible implementation of the first aspect of the embodiments of this application.

[0056] Understandably, the intelligent device provided in the second aspect, the intelligent device provided in the third aspect, the computer storage medium provided in the fourth aspect, and the computer program product provided in the fifth aspect are all used to execute the voice control method provided in the first aspect. Therefore, the beneficial effects they can achieve can be referred to in the beneficial effects of the voice control method provided in the first aspect, and will not be repeated here. Attached Figure Description

[0057] Figure 1 This is a schematic diagram of an exemplary voice control system provided in an embodiment of this application; Figure 2 This is a schematic diagram of the hardware structure of an exemplary smart terminal provided in an embodiment of this application; Figure 3 This is a schematic diagram of the software structure of an exemplary smart terminal provided in an embodiment of this application; Figure 4 This is a schematic flowchart of an exemplary voice control method provided in an embodiment of this application; Figure 5AThis is an exemplary user interface diagram for setting a default app, provided in an embodiment of this application. Figure 5B This is an exemplary user interface diagram for setting a default app, provided in an embodiment of this application. Figure 6 This is a schematic diagram of an exemplary default list provided in an embodiment of this application; Figure 7 This is a flowchart illustrating another exemplary voice control method provided in the embodiments of this application; Figure 8 This is a schematic diagram of an exemplary set-top box voice control process provided in an embodiment of this application; Figure 9 This is a schematic diagram of the structure of another exemplary smart device provided in the embodiments of this application; Figure 10 This is a schematic diagram of the structure of another exemplary smart device provided in the embodiments of this application. Detailed Implementation

[0058] The embodiments of this application are described below with reference to the accompanying drawings.

[0059] The smart terminal involved in this application can install multiple apps, at least some of which support voice interaction. This application categorizes voice commands and, upon receiving a voice command, determines the app that will execute the command from among those supporting that voice command type. This enables cross-app voice interaction, reducing user operations and improving operational efficiency.

[0060] The smart terminals involved in the embodiments of this application may include, for example, set-top boxes, mobile phones, tablet computers, desktop computers, laptops, ultra-mobile personal computers (UMPCs), handheld computers, netbooks, personal digital assistants (PDAs), wearable electronic devices, virtual reality devices, etc. In the following embodiments of this application, a set-top box is used as an example of a smart terminal. A set-top box is a device that connects a television set to an external signal source. It can convert compressed digital signals into video content and display it on a television.

[0061] Figure 1 A schematic diagram of the structure of a voice control system provided in an embodiment of this application is shown. Figure 1 As shown, the voice control system 10 may include: a set-top box 100, an external signal source 200, and a television 300.

[0062] The set-top box 100 can establish a communication connection with an external signal source 200. This external signal source can be a wired cable, satellite dish, broadband network, or terrestrial broadcast, etc. Figure 1 The following explanation uses an external signal source 200 as an example of a broadband network. The set-top box 100 can receive a user's command to watch channel A (or program A) and send this command to the external signal source 200. Upon receiving the command, the external signal source 200 returns the data for channel A (or program A) to the set-top box 100. The set-top box 100 can then convert the data returned by the external signal source 200 and display it on the television set 300 for the user to watch.

[0063] It can be seen that users can input commands via the buttons on the set-top box 100, or via the remote control connected to the set-top box 100. Figure 1 (Not shown in the image) Input commands. Alternatively, the user can input voice commands through the microphone module on the set-top box 100, or through the microphone module on the remote control connected to the set-top box 100. The user input commands involved in the following embodiments of this application are all voice commands.

[0064] The set-top box 100 involved in this application embodiment can be equipped with TVOS or other systems, which can support intelligent voice recognition. Users can operate the set-top box to achieve corresponding functions by inputting voice commands. The following embodiments of this application will use TVOS as an example for illustration. It can be seen that the embodiments of this application can also be applied to Android systems, Linux systems, etc. The embodiments of this application do not limit the specific form of the smart terminal or the system installed on the smart terminal.

[0065] Next, we will introduce the exemplary smart terminal provided in the following embodiments of this application.

[0066] Figure 2 A schematic diagram of the hardware structure of the smart terminal 100 is shown.

[0067] The smart terminal 100 may include a processor 110, a transceiver 120, a display screen 130, buttons 140, an indicator 150, a microphone 160, internal memory 170, a transmission interface 180, and a power management module 190, etc.

[0068] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the smart terminal 100. In other embodiments of this application, the smart terminal 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0069] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0070] The transceiver 120 may include an infrared transceiver for receiving commands sent by the remote control. In this embodiment, the transceiver 120 can be used to receive commands issued by the user operating the remote control, such as commands to switch channels, adjust volume, or turn the smart terminal 100 on or off.

[0071] Display screen 130 can be used to display information such as the current channel of the smart terminal 100. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a miniature LED, a microLED, a quantum dot light-emitting diode (QLED), etc.

[0072] Button 140 may include a power button, volume buttons, channel switching buttons, etc. Button 140 may be a mechanical button or a touch button. The smart terminal 100 can receive button input and generate button signal inputs related to user settings and function control of the smart terminal 100.

[0073] The indicator 150 can be an indicator light, which can be used to indicate the working status of the smart terminal 100, or to indicate notification messages, etc.

[0074] Microphone 160, also known as a "microphone" or "voice transducer," is used to convert sound signals into electrical signals. When a user inputs a voice command, the user can speak by bringing their mouth close to microphone 160, inputting the sound signal into microphone 160. Smart terminal 100 can be equipped with at least one microphone 160. In some embodiments, smart terminal 100 can be equipped with two microphones 160, which, in addition to collecting sound signals, can also perform noise reduction. In other embodiments, smart terminal 100 can be equipped with three, four, or more microphones 160, enabling sound signal collection, noise reduction, sound source identification, and directional recording, among other functions. In this embodiment, the user can input voice commands not only through the microphone 160 on the smart terminal but also through the microphone on a remote control connected to smart terminal 100.

[0075] The internal memory 170 can be used to store computer executable program code, which includes instructions. The internal memory 170 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.). The data storage area may store data created during the use of the smart terminal 100 (such as audio data, video data, user viewing history, etc.). Furthermore, the internal memory 170 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the smart terminal 100 by running instructions stored in the internal memory 170 and / or instructions stored in memory located within the processor.

[0076] The smart terminal interacts with external devices via the transmission interface 180. For example, the smart terminal receives data sent from external devices or sends its own data through this transmission interface. The transmission interface 180 can be, for example, a High Definition Multimedia Interface (HDMI), a DisplayPort (DP), a Digital Visual Interface (DVI), or a Universal Serial Bus (USB) interface. The USB interface can be a Micro USB interface, a USB Type-C interface, etc. In some possible embodiments, the external device can be an external signal source 200, and the transmission interface 180 can be HDMI, DP, DVI, etc. Through this transmission interface 180, the smart terminal 100 can interact with the external signal source 200. For example, the smart terminal 100 can send a user-inputted command to "switch to channel A" to the external signal source 200 through the transmission interface 180, and the external signal source 200 can also send playback content from channel A to the smart terminal 100 through the transmission interface 180, and so on. In some other possible embodiments, the external device can also be a USB device, and the transmission interface 180 can be a USB interface. The external device communicates with the processor 110 through the transmission interface 180 to realize data reading functions. For example, playing music, video, and other files stored on the USB device.

[0077] The power management module 141 is used to connect to an external power source to provide power to the various components of the smart terminal 100 and maintain the normal operation of the smart terminal 100.

[0078] The software system of the smart terminal 100 can adopt a layered architecture. This application embodiment takes the TVOS with a layered architecture as an example to illustrate the software structure of the smart terminal 100.

[0079] Figure 3 This is a software structure block diagram of the smart terminal 100 according to an embodiment of this application.

[0080] The layered architecture comprises several layers, each with a clear role and function. Layers communicate with each other through interfaces. In some embodiments, TVOS is divided into five layers, from top to bottom: the application layer, the application framework layer, the execution environment layer, the component layer, and the Linux kernel layer.

[0081] The application layer can include a series of application packages.

[0082] like Figure 3As shown, the application package may include applications such as iQiyi, Bilibili, System Settings, Kugou, Movie Search, and Smart Home.

[0083] The application framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. For example... Figure 3 As shown, the application framework layer can include JAVA application framework and Web application framework.

[0084] The execution environment layer provides the execution environment for the application framework layer. The Java application execution environment interprets and executes Java bytecode, primarily including the Java Virtual Machine (JVM) and the Java core libraries. This Java application execution environment is called the Television Virtual Machine (TVM), which supports digital television applications. The web application execution environment interprets and executes web pages composed of Hypertext Markup Language (HTML) tags, Cascading Style Sheets (CSS) tags, JavaScript scripts, etc., and is essentially a web browser.

[0085] The component layer is implemented in C / C++ and includes application management components, digital television components, media engine components, multi-screen interaction components, application installation components, intelligent voice components, and file management components. The system services provided mainly include digital television (DTV) and video-on-demand (VOD) services, basic graphical user interface (GUI) services such as window management, event management, and human-computer interaction, and system services such as application management, installation package management, and content management.

[0086] The Linux kernel layer is the layer between hardware and software. It includes at least display drivers, USB drivers, audio drivers, and remote control drivers.

[0087] The following example, using a voice control scenario, illustrates the workflow of the software and hardware of the smart terminal 100.

[0088] When the remote control receives a voice command, the remote control driver in the Linux kernel layer captures the corresponding voice command and sends it to the intelligent voice component in the component layer. The intelligent voice component analyzes the voice command and determines that the type of the voice command is the first type. The application management component in the component layer can find that the APP that executes the voice command of this type is iQiyi. Then, it calls the TVM in the execution environment layer to run the iQiyi APP, so that the iQiyi APP can execute the above voice command and realize voice control.

[0089] Next, combine Figure 1 The voice control system architecture shown is as follows: Figure 2 The hardware structure of the smart terminal shown, and Figure 3 The illustrated software structure diagram of the smart terminal provides a detailed description of the voice control method provided in this application embodiment. This voice control method can be... Figure 1 The process is executed on the smart terminal 100. At least two apps are installed on the smart terminal 100, and each app can support one or more types of voice commands.

[0090] Please see Figure 4 , Figure 4 This is a flowchart illustrating a voice control method provided in an embodiment of this application. Figure 4 As shown, the method includes, but is not limited to, the following steps: S401: Receive voice commands.

[0091] Possibly, the smart terminal 100 can receive voice commands sent by a remote control connected to it via transceiver 120. Specifically, the remote control can receive voice commands input by the user via its microphone and transmit the received voice commands to the smart terminal via wireless transmission methods such as infrared or Bluetooth.

[0092] The smart terminal 100 may also receive voice commands input by the user via the microphone 160.

[0093] S402: Determine the type of voice command as Type 1.

[0094] Specifically, when the smart terminal 100 leaves the factory, the manufacturer or developers can classify the voice commands that users may encounter during use.

[0095] It is possible that manufacturers or developers can create corresponding command libraries for different types of voice commands. When the smart terminal 100 receives a voice command, it can match the voice command with various command libraries, and the command type corresponding to the command library with the highest matching degree is the type of the voice command.

[0096] It is possible that manufacturers or developers can train a voice command recognition model using a large number of known voice command types. When the smart terminal 100 receives a voice command, it can input the voice command into the model, and the type output by the model is the type of the voice command. In this embodiment, the type of voice command received by the smart terminal 100 is referred to as the first type.

[0097] The following examples illustrate some of the voice command types that users may encounter during use, as well as the corresponding voice commands for each voice command type.

[0098] For example, voice commands can be categorized as follows: video-on-demand (com.voice.command.video), live TV programs (com.voice.command.tv), music playback (com.voice.command.music), system settings (com.voice.command.setting), and notifications (com.voice.command.notify). For example, a video-on-demand voice command could be "I want to watch XX variety show" or "I want to watch XX movie." A live TV program voice command could be "I want to watch XX satellite TV channel" or "I want to watch XX channel." A music playback voice command could be "Play XX song," "I want to listen to Jay Chou's songs," or "Please play children's songs." A system settings voice command could be "Please increase the volume," "Please decrease the display brightness," "Please increase the color saturation," or "Please turn off the computer." A notification voice command could be "Please turn on the living room air conditioner" or "Please turn off the kettle."

[0099] It is possible that the smart terminal 100 can research or collect more types of voice commands and the voice commands that may correspond to those types during user use after leaving the factory, and update the operating system of the smart terminal 100 (such as but not limited to TVOS) regularly or irregularly, so that the smart terminal 100 can support more types of voice commands, more comprehensively cover application scenarios, and improve user experience.

[0100] S403: Identify the target app that supports the first type of voice commands from at least two apps installed on the smart terminal.

[0101] First, we'll explain how to determine if an app supports a certain type of voice command.

[0102] Specifically, developers can declare the types of one or more voice commands they support in the configuration files of at least two apps installed on the smart terminal 100. This can be done by filling in the Intent-file field in the configuration file. During app installation, the package manager can retrieve the supported voice command types from the app's configuration file and store them in PackageInfo. The package manager can be located in the application management component at the component layer. Typically, PackageInfo is mainly used to store information about the acquired installation package, which can be recorded through fields such as: package name (packageName), version number (versionCode), version name (versionName), and installation path. In this embodiment, PackageInfo can also be used to store the types of voice commands supported by the app.

[0103] For example, the app is named hiVoiceService, and the app declares the types of voice commands it supports in its configuration file as follows: <service android:name=".hiVoiceService" <intent-filter> <action android:name="com.voice.command" / > <category android:name="com.voice.command.tv" / > <category android:name="com.voice.command.notify" / > < / intent-filter> When the app is installed, the package manager can obtain the supported voice command types from the app's configuration file, namely live TV program type (com.voice.command.tv) and information notification type (com.voice.command.notify), and save the supported voice command types in PackageInfo.

[0104] Secondly, we will explain how to identify which apps support a certain type of voice command.

[0105] When distributing voice commands, the package manager searches for PackageInfo based on the type of the voice command to determine which apps support that type of voice command, and then distributes the voice command to the supporting apps. In this embodiment, the app that supports the first type of voice command can be referred to as the first app.

[0106] To improve the speed of command distribution and avoid the package manager repeatedly searching for PackageInfo, this embodiment of the application can also construct a command relationship table after the package manager obtains the voice command types supported by the APP during APP installation. This relationship table can record the types of voice commands the APP declares it supports and the APP's installation path. Subsequently, when distributing commands, the smart terminal 100 can directly look up the command relationship table to determine which APPs correspond to the first type, i.e., which APPs support the first type of voice commands.

[0107] Not limited to building the command relationship table during APP installation, the smart terminal 100 can also, during the instruction distribution process, when the smart terminal 100 first receives a first type of voice command, and the package manager first searches for APPs supporting the first type of voice command and determines the target APP to execute the command, record the types of voice commands supported by the target APP, and determine the installation path of the APP from the target APP's PackageInfo. When the smart terminal 100 receives other types of voice commands and determines the APP that will ultimately execute the voice command of that type, it can update the command relationship table, adding the types of voice commands supported by that APP and its installation path. This application embodiment does not limit the time for building the command relationship table.

[0108] For example, the command relationship table can be shown in Table 1.

[0109] Table 1 Command Relationship Table

[0110] Finally, we will introduce the methods for identifying target apps, which mainly include the following: Method 1: If the app currently running on the smart terminal 100 supports the first type of voice commands, then the currently running app is the target app.

[0111] Specifically, the currently running app (top-level app) is the app that the user is currently using, i.e., the app that the smart terminal 100 displays to the user through the television 300. The smart terminal 100 can obtain the PackageInfo of the currently running app from the task manager. By determining whether the PackageInfo contains the first type, if it does, the currently running app is identified as the target app.

[0112] Method 2: Select M first apps that support the first type of voice commands from at least two apps installed on the smart terminal 100; then select the target app from the M first apps.

[0113] Specifically, when M=1, that is, when the number of first apps supporting the first type of voice commands is 1, the first app is determined to be the target app. When M is greater than or equal to 2, the target app needs to be further determined from these M first apps.

[0114] At this time, the target APP can be the APP with the highest usage frequency among the M first APPs, or the target APP can be the APP among the M first APPs whose last usage time is closest to the current time.

[0115] It is possible that the smart terminal 100 can also record the apps used by the user at different times of the day. The target app can be the app that the user used the most times during that time period among these M first apps.

[0116] Possibly, the smart terminal 100 can prompt the user that there are M first apps, allowing the user to make a selection. Specifically, the smart terminal 100 can prompt the user of the existence of M first apps through visual or voice prompts, and the user can make a selection through a remote control, button 140, or by inputting a voice command. This application does not limit the method of determining the target app from the M first apps.

[0117] Method 3: Determine if there is a corresponding default app for the first type of voice command. If so, determine that default app as the target app. If not, use Method 2 to determine the target app.

[0118] Specifically, the default app is the app that is used by default to handle this type of voice command. The default app can be set by the manufacturer or by the user according to their own needs.

[0119] Figure 5A and Figure 5B Examples of user interface diagrams for setting default apps are shown. Figure 5A An example is shown showing the user interface for setting the default app corresponding to the video-on-demand class. Figure 5B An example is shown showing the user interface for setting the default app for the music playback class.

[0120] like Figure 5A As shown, the user interface 50 for setting the default APP corresponding to the video-on-demand category may include: a list of command types 510 and a list of APPs that support the voice commands of that type 520.

[0121] Users can select the command type to be set from the command type list 510 using a remote control connected to the smart terminal 100, or users can select the command type to be set from the command type list 510 using the button 140 on the smart terminal 100. The selected command type to be set can be marked to prompt the user.

[0122] Once the user selects the command type to be set, list 520 can display apps that support that command type. The user can select the default app corresponding to that type using the remote control or button 140 on the smart terminal 100. Similarly, the selected default app can be marked to prompt the user.

[0123] The process of setting the default app for music playback is the same as setting the default app for video-on-demand, so it will not be repeated here. However, a comparison... Figure 5A and Figure 5B As can be seen, the list 520 is different for different command types. This is because different apps may support different types of voice commands.

[0124] In addition, users can view the default list. The smart terminal 100 can display the default list to the user via a connected television 300. For example... Figure 6 As shown, the default list can include various voice command types and their corresponding default apps. Users can further modify the default apps through this default list. Specifically, the default apps can be modified via remote control or button 140, or by inputting voice commands. This application embodiment does not limit the method of modifying the default apps.

[0125] After identifying the default app for the first type by searching the default list, the smart terminal 100 can retrieve the app's PackageInfo to obtain its installation path. Alternatively, the default list may include not only the default apps for different command types but also the installation path of those default apps. After identifying the default app for the first type by searching the default list, the smart terminal 100 can also determine the installation path of that default app to run it and execute voice commands.

[0126] S404: Use the target APP to execute voice commands.

[0127] If the target app is a currently running app, the smart terminal 100 can distribute the voice command to the currently running app.

[0128] If the target app is not the currently running app, the smart terminal 100 can stop the currently running app and run the target app. Specifically, the smart terminal 100 can run the target app by looking up the installation path of the target app recorded in PackageInfo, or by looking up the installation path of the target app recorded in the command relationship table.

[0129] If the target app is not the currently running app, the smart terminal 100 can run both the currently running app and the target app simultaneously. Specifically, the smart terminal 100 can divide its current display interface into a first display area and a second display area. The first display area displays the interface of the currently running app, and the second display area displays the interface of the target app.

[0130] Once the target app starts running, you can use it to execute voice commands.

[0131] This application embodiment categorizes voice commands and, upon receiving a voice command, determines the appropriate app from among those supporting that type of voice command. This integrates the apps installed on the smart terminal, enabling cross-app voice interaction. Users no longer need to manually switch apps and then input voice commands, simplifying user operations and improving efficiency.

[0132] Next, combine Figure 7 This application provides a detailed voice control method based on embodiments. For example... Figure 7 As shown, the voice control method may include the following steps: S701: Receives voice commands.

[0133] Specifically, S701 is the same as S401, which will not be elaborated here.

[0134] S702: Determine the type of the voice command as Type I.

[0135] Specifically, S702 is the same as S402, which will not be elaborated here.

[0136] S703: Get the PackageInfo of the top-level APP from the Task Manager.

[0137] Specifically, after determining that the user's voice command is of type 1, it can be prioritized to determine whether the top-level APP supports type 1 voice commands.

[0138] Among them, the top-level APP is the APP that is currently running, that is, the APP that the user is currently using, which is the APP that the smart terminal 100 displays to the user through the TV 300.

[0139] S704: Determine if the PackageInfo of the top-level APP contains the first type. If yes, proceed to S705; otherwise, proceed to S706.

[0140] Specifically, the process of determining whether PackageInfo contains the first type can be found in the aforementioned description of how to determine whether an app supports a certain type of voice command, which will not be repeated here.

[0141] S705: Send voice commands to the top-level APP.

[0142] Once the top-level app supports the first type of voice command, the voice command can be directly sent to the top-level app for execution. This prioritizes the currently running app as the target app and dispatches voice commands based on the current application scenario, improving the accuracy of voice command dispatch and enhancing the user experience.

[0143] S706: Determine if there is a default app corresponding to the first type of voice command. If yes, execute S707; otherwise, execute S709.

[0144] S707: Send voice commands to the default app.

[0145] Specifically, for details of S706-S707, please refer to the description of method three for determining the target APP in S403, which will not be repeated here.

[0146] S708: Run the default app.

[0147] Specifically, for details on how to run the default APP, please refer to the section in S404 regarding the target APP not being the currently running APP; it will not be repeated here.

[0148] S709: Query the command relationship table to determine the M apps that support the first type of voice commands.

[0149] Specifically, the command relationship table can be found in Table 1, and will not be repeated here.

[0150] S710: Select the target app from M apps.

[0151] Specifically, the method for selecting the target APP from M APPs can be found in the description of method two for determining the target APP in S403, and will not be repeated here.

[0152] S711: Run the target app.

[0153] Specifically, the method for running the target APP can be found in the description of the part of S404 regarding the target APP not being a currently running APP, and will not be repeated here.

[0154] S712: Execute voice commands.

[0155] Specifically, if the currently running app supports the first type of voice command, then the voice command can be executed directly using the currently running app. If the currently running app does not support the first type of voice command, then the voice command can be executed using the target app or the default app once it starts running.

[0156] If the currently running app does not support the first type of voice command, and there is no default app for the first type of voice command, and there is no app on the smart terminal 100 that supports the first type of voice command, then no action will be taken, or the user will be prompted that the voice command entered is incorrect.

[0157] This application embodiment categorizes voice commands and, upon receiving a voice command, determines the appropriate app from among those supporting that type of voice command. This integrates the apps installed on the smart terminal, enabling cross-app voice interaction. Users no longer need to manually switch apps and then input voice commands, simplifying user operations and improving efficiency.

[0158] Figure 8 A schematic diagram of the voice control process for a set-top box is shown. Figure 8 As shown, TVOS can be installed on the set-top box, and based on TVOS, multiple apps can be installed on the set-top box. Figure 8 The example illustrates three apps (APP1, APP2, and APP3). TVOS can capture voice commands, receive commands, and send the commands to a command distributor. The command distributor then sends the voice command to the corresponding app. The command distribution method of the command distributor can refer to the methods for determining the target app in the previous embodiments, which will not be repeated here.

[0159] The methods of the embodiments of this application have been described in detail above. The apparatus of the embodiments of this application is provided below.

[0160] Please see Figure 9 , Figure 9 This is a schematic diagram of the structure of a smart device provided in an embodiment of this application. The smart device can be used for... Figure 2 The illustrated smart terminal has at least two application software APPs installed on it, each APP supporting one or more types of voice commands. The smart device 90 may include a receiving module 910, a first determining module 920, and a second determining module 930. Wherein: The receiving module 910 is used to receive voice commands. For details, please refer to the description in S401; it will not be repeated here.

[0161] The first determining module 920 is used to determine that the type of the above voice command is the first type. For details, please refer to the description of S402, which will not be repeated here.

[0162] The second determining module 930 is used to determine, from at least two apps installed on the smart terminal, a target app that supports the first type of voice commands described above. For details, please refer to the description in S403; it will not be repeated here.

[0163] The target app can be used to execute the aforementioned voice commands. Please refer to the description in S404 for details; further elaboration will not be repeated here.

[0164] In one possible implementation, the first determining module can be Figure 3 The intelligent voice component in the component layer, the second determining module mentioned above can be... Figure 3 Application management components in the component layer.

[0165] In one possible implementation, the smart device 90 further includes a declaration module for declaring, in the configuration files of at least two apps installed on the smart terminal, the types of one or more voice commands supported by each app.

[0166] In one possible implementation, the second determining module 930 is specifically used for: From at least two apps installed on a smart terminal, identify M first apps that support the first type of voice commands mentioned above; M is a positive integer; from the M first apps, identify the target app.

[0167] In one possible implementation, the second determining module 93 is specifically used to: determine whether there is a corresponding default APP for the first type of voice command; the default APP is the APP that is used to process the first type of voice command by default; if there is a corresponding default APP for the first type of voice command, determine the default APP corresponding to the first type of voice command as the target APP.

[0168] In one possible implementation, the second determining module 930 is specifically used to: determine whether there is a corresponding default APP for the voice command of the first type; the default APP is the APP that is used to process the voice command of the first type by default; if there is no corresponding default APP for the voice command of the first type, determine M first APPs that support the voice command of the first type from at least two APPs installed on the smart terminal; M is a positive integer; determine the target APP from the M first APPs.

[0169] In one possible implementation, the target app is the most frequently used app among the apps that support the first type of voice commands, or the target app is the app whose last usage time is closest to the current time among the apps that support the first type of voice commands.

[0170] In one possible implementation, if the app currently running on the smart terminal supports the first type of voice commands described above, the target app is the currently running app.

[0171] In one possible implementation, the APP supporting the first type of voice commands is obtained based on a command relationship table, which includes at least two APPs installed on the smart terminal and the voice command types supported by each of the at least two APPs.

[0172] In one possible implementation, the app currently running on the smart terminal is not the target app mentioned above.

[0173] The smart device 90 also includes a running module for running the aforementioned target APP.

[0174] In one possible implementation, the runtime module can be... Figure 3 TVM in the execution environment layer.

[0175] In one possible implementation, the smart device 90 further includes a stop-run module, used to stop the currently running APP before the running module runs the target APP.

[0176] In one possible implementation, the command relationship table mentioned above also includes the installation paths of each of the at least two apps.

[0177] The execution module is specifically used to: look up the command relationship table, determine the installation path of the target APP, and run the target APP according to the installation path of the target APP.

[0178] The smart device provided in this application embodiment can classify voice commands. Upon receiving a voice command, it determines the appropriate app to execute the command from among those apps that support that type of voice command. This integrates the apps installed on the smart terminal, enabling cross-app voice interaction. Users no longer need to manually switch apps and then input voice commands, simplifying user operations and improving efficiency.

[0179] Please see Figure 10 , Figure 10 This is another smart device provided in the embodiments of this application, which can be used for... Figure 2The illustrated smart terminal has at least two application software programs (APPs) installed on it, each APP supporting one or more types of voice commands. The smart device 400 includes a processor 410 and a transmission interface 420. Optionally, the smart device 400 may also include a memory 430. The processor 410, memory 430, and transmission interface 420 are interconnected via a bus 440.

[0180] The memory 430 includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM), and is used for related instructions and data. The transmission interface 420 is used for receiving and sending data.

[0181] Processor 410 can be one or more central processing units (CPUs), microcontroller units (MCUs), graphics processing units (GPUs), image signal processors (ISPs), neural network processing units (NPUs), digital signal processors (DSPs), and application processors (APs). If processor 410 is a CPU, it can be a single-core CPU or a multi-core CPU.

[0182] The processor 410 in the smart device 400 is configured to invoke software instructions stored in the memory 430 to execute: The system receives voice commands through the transmission interface 420; determines that the type of the voice command is a first type; identifies a target app that supports the first type of voice commands from at least two apps installed on the smart terminal; and executes the voice command using the target app.

[0183] In one possible implementation, before receiving the voice command, the processor 410 further performs the following: declaring, in the configuration files of at least two apps installed on the smart terminal, the types of one or more voice commands supported by each app.

[0184] In one possible implementation, when the processor 410 executes the process of determining a target APP that supports the first type of voice commands from at least two APPs installed on the smart terminal, it specifically performs the following: determining M first APPs that support the first type of voice commands from at least two APPs installed on the smart terminal; M is a positive integer; and determining the target APP from the M first APPs.

[0185] In one possible implementation, when the processor 410 executes the process of determining a target APP that supports the first type of voice commands from at least two APPs installed on the smart terminal, it specifically performs the following: determining whether there is a corresponding default APP for the first type of voice commands; the default APP being the APP that defaults to processing the first type of voice commands; and if there is a corresponding default APP for the first type of voice commands, determining the default APP corresponding to the first type of voice commands as the target APP.

[0186] In one possible implementation, when the processor 410 executes the process of determining a target app that supports the first type of voice commands from at least two apps installed on the smart terminal, it specifically performs the following steps: determining whether there is a corresponding default app for the first type of voice commands; the default app is the app that defaults to processing the first type of voice commands; if there is no corresponding default app for the first type of voice commands, determining M first apps that support the first type of voice commands from at least two apps installed on the smart terminal; M is a positive integer; and determining the target app from the M first apps.

[0187] In one possible implementation, the target app is the most frequently used app among the apps that support the first type of voice commands, or the target app is the app whose last usage time is closest to the current time among the apps that support the first type of voice commands.

[0188] In one possible implementation, if the APP currently running on the aforementioned smart terminal supports the first type of voice commands, the target APP is the currently running APP.

[0189] In one possible implementation, the APP supporting the first type of voice commands is obtained based on a command relationship table, which includes at least two APPs installed on the smart terminal and the voice command types supported by each of the at least two APPs.

[0190] In one possible implementation, the APP currently running on the aforementioned smart terminal is not the aforementioned target APP; before the processor 410 executes the aforementioned voice command using the aforementioned target APP, the processor 410 also executes: running the aforementioned target APP.

[0191] In one possible implementation, before the processor 410 runs the target APP, the processor 410 also performs the following: stop running the currently running APP.

[0192] In one possible implementation, the command relationship table also includes the installation paths of the at least two apps respectively; when the processor 410 runs the target app, it specifically performs the following: searches the command relationship table, determines the installation path of the target app, and runs the target app according to the installation path of the target app.

[0193] The smart device provided in this application embodiment can classify voice commands. Upon receiving a voice command, it determines the appropriate app to execute the command from among those apps that support that type of voice command. This integrates the apps installed on the smart terminal, enabling cross-app voice interaction. Users no longer need to manually switch apps and then input voice commands, simplifying user operations and improving efficiency.

[0194] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer or processor, cause the computer or processor to perform one or more steps of any of the above methods. If the constituent modules of the above-described intelligent device are implemented as software functional units and sold or used as independent products, they can be stored in the computer-readable storage medium.

[0195] In the above embodiments, implementation can be achieved entirely or partially through software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented entirely or partially as a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted through the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available media may be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., digital video discs (DVDs)), or semiconductor media (e.g., solid-state disks (SSDs)).

[0196] This application also provides a computer program product that, when run on a smart terminal, provides a solution for... Figure 4 or Figure 7 The method and flow shown are thus implemented.

[0197] Those skilled in the art will understand that all or part of the processes in the above embodiments can be implemented by a computer program instructing related hardware. The program can be stored in a computer-readable storage medium, and when executed, it can include the processes of the embodiments of the above methods. The storage medium can be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0198] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.

[0199] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.

[0200] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A voice control method, characterized in that, The method is applied to a smart terminal, and the method includes: Receive the first voice command; The first voice command is input into the voice command recognition model to obtain the first type of the first voice command output. The command relationship table is searched according to the first type, and a target APP that supports the first type is determined. The command relationship table includes the types of voice commands supported by at least two APPs on the smart terminal. The types of voice commands supported by the target APP in the command relationship table are obtained from the first field of the target APP. The first field of the target APP includes the declared types of one or more voice commands supported by the target APP. The first voice command is executed using the target APP.

2. The method as described in claim 1, characterized in that, The first field of the target APP is a field in the configuration file of the target APP.

3. The method as described in claim 2, characterized in that, The first field is the Intent-filter field.

4. The method according to any one of claims 1-3, characterized in that, The smart terminal includes a packet manager, and before receiving the first voice command, the method further includes: The package manager obtains the types of voice commands supported by the at least two apps based on the first field of the at least two apps; Generate the command relationship table.

5. The method according to any one of claims 1-4, characterized in that, The step of searching the command relationship table according to the first type and determining the target APP that supports the first type includes: Based on the first type, the command relationship table is searched to determine M first apps from the at least two apps; M is a positive integer, and the voice command types supported by the M first apps include the first type; The target app is determined from the M first apps.

6. The method as described in claim 5, characterized in that, The step of determining the target APP from the M first APPs includes: Based on the recorded user's operating habits with the APP, the target APP is determined from the M first APPs.

7. The method as described in claim 6, characterized in that, The target app is the app with the highest usage frequency among the M first apps; or... The target APP is the APP among the M first APPs whose last usage time is closest to the current time; or, The target APP is the APP that the user selects from the M first APPs after being prompted by the user.

8. The method according to any one of claims 1-7, characterized in that, The method further includes: Receive the second voice command; The second voice command is input into the voice command recognition model to obtain the second type of the output second voice command; The command relationship table is searched according to the second type, and the target APP that supports the second type is determined; The type of voice commands supported by the target APP is updated in the command relationship table to include the second type.

9. The method according to any one of claims 1-8, characterized in that, The step of searching the command relationship table according to the first type and determining the target APP that supports the first type includes: If there is no corresponding default APP for the first type of voice command, the command relationship table is searched according to the first type, and the target APP that supports the first type is determined; the default APP corresponding to the first type of voice command is the APP that defaults to processing the first type of voice command. The method further includes: If there is a corresponding default APP for the first type of voice command, the default APP corresponding to the first type of voice command is determined to be the target APP.

10. The method as described in claim 9, characterized in that, The method further includes: Receive the user's first input to select the first default app; Based on the first input, the first default APP is determined to be the default APP corresponding to the first type of voice command.

11. A smart terminal, characterized in that, include: One or more processors and one or more memories, the one or more memories being used to store a program that, when executed on the one or more processors, causes the electronic device to perform the method as described in any one of claims 1-10.

12. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed on an electronic device, implement the method as described in any one of claims 1-10.

13. A program product, characterized in that, Includes a program, which, when run on an electronic device, is used to implement the method as described in any one of claims 1-10.

14. A chip system, characterized in that, It includes a processing circuit and an interface circuit, the interface circuit being used to receive instructions and transmit them to the processing circuit, the processing circuit being used to execute the instructions to perform the method as described in any one of claims 1-10.

Images