Smart TV Voice Control Background Update Method, Device, TV Set and Media

Abstract

This invention relates to the field of digital television, and particularly to a background update method, device, television set, and medium for voice control of smart televisions. After detecting an update to the historical interface of a target application on the smart television, the method updates the historical node tree corresponding to the historical interface based on all control elements in the updated current interface, the layout relationships between all control elements, and the attribute information of each control element. This results in a current node tree corresponding to the current interface. When a user issues a voice control command for the current interface, the current node tree is used to locate the corresponding position of the voice control command within the current interface, thereby executing the voice control command at that position. This simplifies the response process of voice control commands for target applications on the smart television and improves the response speed.

Description

Technical Field

[0001] This invention relates to the field of digital television, and more particularly to a background update method, device, television set, and medium for voice control of smart televisions. Background Technology

[0002] Currently, most smart TVs support voice control. This technology not only provides users with a more convenient way to operate the TV, but also enhances the intelligence level of the user experience through the introduction of artificial intelligence. However, the voice control function of smart TVs still faces some challenges in practical applications. For some smart TVs with voice control, voice can only control the TV manufacturer's system applications and self-developed applications. If it is desired to control third-party applications by voice, complex integration and adaptation are required. In this process, voice control commands need to go through multiple intermediate processing steps, including speech recognition, semantic understanding, command parsing, and application invocation. This not only increases the complexity of the system and development costs, but also leads to a decrease in response speed, affecting the user experience. Therefore, how to optimize the response process of smart TVs for application voice control commands to improve response speed has become an urgent problem to be solved. Summary of the Invention

[0003] Based on this, a background update method, device, television set, and medium for voice control of smart TVs are provided to solve the problem of optimizing the response process of voice control commands for applications on smart TVs, thereby improving response speed.

[0004] In a first aspect, embodiments of the present invention provide a background update method for voice control of a smart TV, the background update method comprising the following steps:

[0005] After detecting an update to the historical interface of the target application in the smart TV, determine all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element. For any control element, the attribute information of the control element includes at least the position attribute of the control element.

[0006] Based on all control elements in the current interface, the layout relationships between all control elements, and the attribute information of each control element, the historical node tree corresponding to the historical interface is updated to obtain the current node tree corresponding to the current interface.

[0007] The current node tree is used to locate the corresponding position of the voice control command in the current interface when a user's voice control command is received for the current interface, so as to execute the voice control command at the position.

[0008] Secondly, embodiments of the present invention provide a background update device for voice control of a smart TV, the background update device comprising:

[0009] The determination module is used to determine, after listening to the historical interface update of the target application in the smart TV, all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element, wherein, for any control element, the attribute information of the control element includes at least the position attribute of the control element.

[0010] The first update module is used to update the historical node tree corresponding to the historical interface based on all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element, so as to obtain the current node tree corresponding to the current interface.

[0011] The current node tree is used to locate the corresponding position of the voice control command in the current interface when a user's voice control command is received for the current interface, so as to execute the voice control command at the position.

[0012] Thirdly, embodiments of the present invention provide a television set, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the computer program to implement the steps of the background update method described in the first aspect.

[0013] Fourthly, embodiments of the present invention provide a computer-readable storage medium storing a computer program, which, when executed by a processor, implements the steps of the background update method described in the first aspect.

[0014] The technical effects achieved by this invention, which differ from existing technologies, are as follows: After detecting a historical interface update of a target application on a smart TV, the background update method of this invention updates the historical node tree corresponding to the historical interface based on all control elements in the updated current interface, the layout relationships between all control elements, and the attribute information of each control element, to obtain the current node tree corresponding to the current interface. The current node tree is used to locate the corresponding position of the voice control command in the current interface when a user's voice control command for the current interface is received, so as to execute the voice control command at that position.

[0015] Specifically, by monitoring updates to the target application's historical interface, the system updates the historical node tree corresponding to the historical interface based on the current interface, thus obtaining the current node tree corresponding to the current interface. This allows the system to quickly locate the corresponding position of the voice control command when receiving a user's voice control command for the current interface, without having to search through layers of the interface. This simplifies the response process of smart TVs to voice control commands for the target application, improves the response speed of voice control commands, and brings a better voice control experience to users. Attached Figure Description

[0016] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a flowchart illustrating a background update method for voice control of a smart TV provided in Embodiment 1 of the present invention;

[0018] Figure 2 This is a schematic diagram of the overall process of a background update method for voice control of a smart TV provided in Embodiment 1 of the present invention;

[0019] Figure 3 This is a flowchart illustrating a background update method for voice control of a smart TV provided in Embodiment 2 of the present invention;

[0020] Figure 4 This is a flowchart illustrating a background update method for voice control of a smart TV provided in Embodiment 3 of the present invention;

[0021] Figure 5 This is a schematic diagram of the structure of a background update device for voice control of a smart TV provided in Embodiment 4 of the present invention;

[0022] Figure 6 This is a schematic diagram of the structure of a television set provided in Embodiment 5 of the present invention. Detailed Implementation

[0023] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0024] It should be understood that the sequence number of each step in the following embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0025] like Figure 1 The diagram shown is a flowchart illustrating a background update method for voice control of a smart TV according to Embodiment 1 of the present invention. This method is executed by the processor built into the TV and may include the following steps:

[0026] Step S101: After detecting an update to the historical interface of the target application on the smart TV, determine all control elements in the updated current interface, the layout relationships between all control elements, and the attribute information of each control element.

[0027] In this embodiment, the target application can refer to a third-party application installed on a smart TV, the historical interface can refer to the window interface displayed by the target application on the smart TV before the update, the current interface can refer to the window interface displayed by the target application on the smart TV after the update, the control element can refer to the element in the current interface used to interact with the user, allowing the user to input data, select options, or view information, such as buttons, text boxes, drop-down lists, and sliders, etc., the layout relationship can refer to the distribution relationship of control elements in the current interface, for example, for the two control elements of a button and a text box, the layout relationship between the two can be that the button is placed inside the text box, or the button is placed outside the text box, etc., the attribute information can refer to the information that characterizes the features of the control element, wherein, for any control element, the attribute information of the control element includes at least the position attribute of the control element, the position attribute is used to characterize the position of the control element in the current interface, for example, the attribute information can include the name, position, and content displayed of the control element, etc.

[0028] Step S102: Based on all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element, update the historical node tree corresponding to the historical interface to obtain the current node tree corresponding to the current interface.

[0029] In this embodiment, the historical node tree can refer to a node tree representing the control element information and interface hierarchy of the historical interface, obtained based on all control elements in the historical interface, the layout relationship between all control elements, and the attribute information of each control element. The current node tree can refer to a node tree representing the control element information and interface hierarchy of the current interface, obtained by updating the historical node tree based on all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element. The current node tree is used to locate the corresponding position of the voice control command in the current interface when a voice control command is received from the user for the current interface, so as to execute the voice control command at that position.

[0030] Specifically, the current node tree can be obtained by updating all nodes in the historical node tree and the structural relationships between all nodes based on all control elements in the current interface, the layout relationships between all control elements, and the attribute information of each control element.

[0031] Optionally, before detecting an update to the historical interface of the target application on the smart TV, it is also possible to listen for update events to the historical interface, determine the event type of the update event, and update the historical interface according to the event type to obtain the current interface.

[0032] Among them, the update event can refer to the update operation of the historical interface. For example, the update event can be the user-triggered update operation of the historical interface or the automatic jump update of the historical interface. The event type of the update event can refer to the specific operation corresponding to the update event, such as click, selection, focus acquisition and text change event types.

[0033] Specifically, a corresponding helper class can be created to listen for update events of the historical interface, and perform corresponding update operations on the historical interface according to the event type of the listened update event to obtain the current interface.

[0034] For example, such as Figure 2 The diagram shown is a schematic representation of the overall process of a background update method provided in Embodiment 1 of this application. The target application is a third-party application installed on a television. A corresponding node tree can be constructed based on the interface of the third-party application. In the node tree, the root node represents the interface of the third-party application, and the child nodes represent the control elements in the interface of the third-party application.

[0035] This background update service can be configured by creating a helper class that inherits from AccessibilityService, specifying its permissions and service parameters, including listening for UI update events of specified third-party applications, the types of events to be listened to, and the interval for obtaining the event types, and then adding it to the TV's startup service; 2) In the onAccessibilityEvent method, listen for update events of the historical interface of third-party applications, and perform corresponding update operations on the historical interface according to the event type of the listened update event (e.g., focus change) to obtain the current interface; 3) Obtain all control elements in the current interface, the layout relationship between all control elements, and the information of each control element. 4) Update the historical node tree corresponding to the historical interface based on all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element, to obtain the current node tree corresponding to the current interface; 5) When a user's voice control command for the current interface is received (e.g., "I want to see ×××"), the voice control command is parsed to determine the target control object corresponding to the voice control command. Based on the target control object, the current node tree is traversed (analyzing the current interface information of the third-party application) to determine the target control element corresponding to the target control object (e.g., clicking node ×××). Based on the attribute information of the target control element, the voice control command is executed in the current interface (e.g., simulating a click).

[0036] In this embodiment, after monitoring the historical interface update of the target application, the historical node tree corresponding to the historical interface is updated according to the current interface to obtain the current node tree corresponding to the current interface. This allows the system to quickly locate the position corresponding to the voice control command when receiving a voice control command from the user for the current interface, without having to search through layers of the interface. This simplifies the response process of the smart TV to the voice control command of the target application, improves the response speed to the voice control command, and brings a better voice control experience to the user.

[0037] like Figure 3 The diagram shown is a flowchart of a background update method provided in Embodiment 2 of the present invention. In step S102 above, the historical node tree corresponding to the historical interface is updated according to all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element to obtain the current node tree corresponding to the current interface. This step may include the following steps:

[0038] Step S301: Obtain the history node tree and update the history interface represented by the root node of the history node tree to the current interface.

[0039] Step S302: Starting from the root node of the history node tree, traverse all child nodes in the history node tree. For any child node in the history node tree, compare the control element represented by the child node with all control elements of the current interface.

[0040] Step S303: If there is a control element among all the control elements on the current interface that matches the control element represented by the child node, then the child node is retained; otherwise, the child node is removed from the historical node tree to obtain the first updated node tree.

[0041] Step S304: Determine any mismatched control elements in the current interface. For any mismatched control element in the current interface, create a new child node in the first update node tree to represent the mismatched control element, and associate the attribute information of the mismatched control element with the new child node to obtain the second update node tree.

[0042] Step S305: Based on the layout relationship between all control elements in the current interface, adjust the positions of all child nodes in the second updated node tree to obtain the current node tree.

[0043] In this embodiment, the first updated node tree can refer to the node tree obtained by updating the historical node tree, and the second updated node tree can refer to the node tree obtained by updating the first updated node tree.

[0044] Specifically, in the process of updating the historical node tree to obtain the current node tree, firstly, the historical interface represented by the root node of the historical node tree is updated to the current interface. Starting from the root node of the historical node tree, all child nodes in the historical node tree are traversed. For any child node in the historical node tree, the control element represented by the child node is compared with all control elements in the current interface. If there is a control element in the current interface that matches the control element represented by the child node, the child node is retained; otherwise, the child node is removed from the historical node tree to obtain the first updated node tree. Then, for any unmatched control element in the current interface... For each control element, a new child node is created in the first update node tree to represent the mismatched control element. The attribute information of the mismatched control element is then associated with the new child node to obtain the second update node tree. Finally, based on the layout relationship between all control elements in the current interface, the structural relationship (parent-child relationship, sibling relationship) between all child nodes in the second update node tree is determined. Based on the structural relationship, the positions of all child nodes in the second update node tree are adjusted until the layout range of the control element in the current interface gradually shrinks along the path from the root node to any leaf node in the second update node tree, thus obtaining the current node tree.

[0045] In this embodiment, by automatically comparing the control elements of the historical interface and the current interface to update the historical node tree, the control elements that have changed can be quickly identified, thereby performing update operations such as adding and / or deleting nodes in the historical node tree to obtain the current node tree, which improves the update efficiency of the node tree.

[0046] like Figure 4 As shown in the flowchart of a background update method provided in Embodiment 3 of the present invention, after obtaining the current node tree corresponding to the current interface in step S102 above, the method may further include the following steps:

[0047] Step S401: When a voice control command is received from the user for the current interface, the voice control command is parsed to determine the target control object corresponding to the voice control command.

[0048] Step S402: Based on the target control object, traverse the current node tree to determine the target control element corresponding to the target control object.

[0049] Step S403: Execute voice control commands on the current interface based on the attribute information of the target control element.

[0050] In this embodiment, the voice control command can refer to the user's voice control command for the current interface. For example, the voice control command can be clicking a button on the current interface or entering text in a text box on the current interface. The target control object can refer to the control object corresponding to the voice control command, and the target control element can refer to the control element corresponding to the target control object on the current interface.

[0051] Specifically, in the process of receiving and executing the user's voice control command for the current interface, firstly, the voice control command is parsed to determine the target control object corresponding to the voice control command. For example, if the voice control command is "Please click the search box", it can be parsed to determine that the target control object is the search box. Then, based on the target control object, the current node tree is traversed to determine the target control element corresponding to the target control object. Finally, based on the position attribute of the target control element, the absolute position of the target control element in the current interface is determined (i.e., the exact position of the control element relative to the current interface, including the horizontal and vertical distances). Based on the absolute position, the target control element is located in the current interface, and the voice control command is executed on the target control element.

[0052] In this embodiment, when a user issues a voice control command for the current interface, the system can quickly locate the corresponding position of the voice control command based on the current node tree, without having to search through layers of the interface. This simplifies the response process of smart TVs to voice control commands for target applications, improves the response speed of voice control commands, and provides users with a better voice control experience.

[0053] like Figure 5 The diagram shown is a structural schematic of a background update device for voice control of a smart TV according to Embodiment 4 of this application. This background update device corresponds one-to-one with the background update methods in the above embodiments. The background update device includes a determining module 51 and a first update module 52. Detailed descriptions of each functional module are as follows:

[0054] The determining module 51 is used to determine, after listening to the historical interface update of the target application in the smart TV, all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element, wherein, for any control element, the attribute information of the control element includes at least the position attribute of the control element.

[0055] The first update module 52 is used to update the historical node tree corresponding to the historical interface based on all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element, so as to obtain the current node tree corresponding to the current interface.

[0056] The current node tree is used to locate the corresponding position of the voice control command in the current interface when a user's voice control command is received for the current interface, so as to execute the voice control command at the position.

[0057] Optionally, the background update device also includes:

[0058] A listening module is used to listen for update events to the historical interface;

[0059] The second update module is used to determine the event type of the update event, and update the historical interface according to the event type to obtain the current interface.

[0060] Optionally, the first update module 52 described above includes:

[0061] The acquisition unit is used to acquire the historical node tree and update the historical interface represented by the root node of the historical node tree to the current interface.

[0062] The comparison unit is used to traverse all child nodes in the history node tree starting from the root node of the history node tree, and for any child node in the history node tree, perform a consistency comparison between the control element represented by the child node and all control elements of the current interface.

[0063] The third update unit is used to retain the child node if there is a control element among all the control elements of the current interface that matches the control element represented by the child node; otherwise, the child node is removed from the historical node tree to obtain the first update node tree.

[0064] The fourth update unit is used to determine the control elements in the current interface that are not matched. For any control element in the current interface that is not matched, a new child node is created in the first update node tree to represent the control element that is not matched, and the attribute information of the control element that is not matched is associated with the new child node to obtain the second update node tree.

[0065] The fifth update unit is used to adjust the positions of all child nodes in the second update node tree according to the layout relationship between all control elements in the current interface, so as to obtain the current node tree.

[0066] Optionally, the fifth update unit mentioned above includes:

[0067] The structure determination subunit is used to determine the structural relationship between all child nodes in the second update node tree based on the layout relationship between all control elements in the current interface.

[0068] The structural adjustment subunit is used to adjust the positions of all child nodes in the second updated node tree according to the structural relationship, until the layout range of control elements in the current interface gradually shrinks along the path from the root node to any leaf node in the second updated node tree, thus obtaining the current node tree.

[0069] Optionally, the background update device also includes:

[0070] The parsing module is used to parse the voice control command received from the user for the current interface and determine the target control object corresponding to the voice control command.

[0071] The traversal module is used to traverse the current node tree based on the target control object to determine the target control element corresponding to the target control object;

[0072] An execution unit is used to execute the voice control command in the current interface based on the attribute information of the target control element.

[0073] Optionally, the above-mentioned execution unit includes:

[0074] The position determination subunit is used to determine the absolute position of the target control element in the current interface based on the position attribute corresponding to the target control element;

[0075] The location positioning subunit is used to locate the target control element in the current interface according to the absolute position, and execute the voice control command on the target control element.

[0076] For specific limitations regarding the background update device, please refer to the limitations on the background update method above, which will not be repeated here. Each module in the aforementioned background update device can be implemented entirely or partially through software, hardware, or a combination thereof. These modules can be embedded in the processor of the television in hardware form or independent of it, or stored in the memory of the television in software form, so that the processor can call and execute the corresponding operations of each module.

[0077] Figure 6 This is a schematic diagram of a television set according to Embodiment 5 of the present invention. Figure 6 As shown, the television set of this embodiment includes: at least one processor ( Figure 6 Only one is shown in the diagram), a memory, and a computer program stored in the memory and executable on at least one processor, wherein the processor executes the computer program to implement the steps in any of the above-described background update method embodiments.

[0078] The television set may include, but is not limited to, a processor and memory. Those skilled in the art will understand that... Figure 6 This is merely an example of a television set and does not constitute a limitation on television sets. A television set may include more or fewer components than shown in the illustration, or a combination of certain components, or different components, such as a network interface, a display screen, and input devices.

[0079] The processor referred to can be a Central Processing Unit (CPU), but it can also be other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor can be a microprocessor or any conventional processor.

[0080] The memory includes readable storage media, internal memory, etc., wherein the internal memory can be the main memory of the television, providing an environment for the operation of the operating system and computer-readable instructions stored in the readable storage media. The readable storage media can be the television's hard drive, or in other embodiments, an external storage device of the television, such as a plug-in hard drive, Smart Media Card (SMC), Secure Digital (SD) card, or Flash Card. Furthermore, the memory can include both internal storage units of the television and external storage devices. The memory is used to store the operating system, applications, bootloader, data, and other programs, such as program code for computer programs. The memory can also be used to temporarily store data that has been output or will be output.

[0081] Those skilled in the art will understand that, for the sake of convenience and brevity, the above-described division of functional units and modules is used as an example. In practical applications, the functions described above can be assigned to different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit. Furthermore, the specific names of the functional units and modules are only for easy differentiation and are not intended to limit the scope of protection of this invention. The specific working process of the units and modules in the above device can be referred to the corresponding process in the foregoing method embodiments, and will not be repeated here. If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present invention can implement all or part of the processes in the methods of the above embodiments by instructing related hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when executed by a processor, it can implement the steps of the above method embodiments. The computer program includes computer program code, which can be in the form of source code, object code, executable files, or certain intermediate forms. A computer-readable medium can include at least: any entity or device capable of carrying computer program code, a recording medium, a computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signals, telecommunication signals, and software distribution media. Examples include USB flash drives, portable hard drives, magnetic disks, or optical disks. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electrical carrier signals or telecommunication signals.

[0082] The present invention can implement all or part of the processes in the above embodiments of the method, or it can be accomplished by a computer program product. When the computer program product is run on a television set, the television set executes the steps in the above method embodiments.

[0083] In the above embodiments, the descriptions of each embodiment have different focuses. For parts that are not described in detail or recorded in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0084] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0085] In the embodiments provided by this invention, it should be understood that the disclosed device / television and method can be implemented in other ways. For example, the device / television embodiments described above are merely illustrative. For instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0086] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0087] The above embodiments are only used to illustrate the technical solutions of the present invention, and are not intended to limit it. Although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included within the protection scope of the present invention.

Claims

1. A background update method for voice control of a smart TV, characterized in that, The background update method includes the following steps: After detecting an update to the historical interface of the target application in the smart TV, determine all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element. For any control element, the attribute information of the control element includes at least the position attribute of the control element. Based on all control elements in the current interface, the layout relationships between all control elements, and the attribute information of each control element, the historical node tree corresponding to the historical interface is updated to obtain the current node tree corresponding to the current interface. The current node tree is used to locate the corresponding position of the voice control command in the current interface when a user's voice control command for the current interface is received, so as to execute the voice control command at the position. The step of updating the historical node tree corresponding to the historical interface based on all control elements in the current interface, the layout relationships between all control elements, and the attribute information of each control element, to obtain the current node tree corresponding to the current interface, includes: Obtain the historical node tree, and update the historical interface represented by the root node of the historical node tree to the current interface; Starting from the root node of the history node tree, traverse all child nodes in the history node tree. For any child node in the history node tree, compare the control element represented by the child node with all control elements of the current interface. If there is a control element among all the control elements of the current interface that matches the control element represented by the child node, then the child node is retained; otherwise, the child node is removed from the historical node tree to obtain the first updated node tree. Identify any mismatched control elements in the current interface. For any mismatched control element in the current interface, create a new child node in the first update node tree to represent the mismatched control element, and associate the attribute information of the mismatched control element with the new child node to obtain the second update node tree. Based on the layout relationship between all control elements in the current interface, the positions of all child nodes in the second updated node tree are adjusted to obtain the current node tree.

2. The background update method as described in claim 1, characterized in that, Before detecting an update to the target application's historical interface on the smart TV, the method further includes: Listen for update events to the historical interface; Determine the event type of the update event, and update the historical interface according to the event type to obtain the current interface.

3. The background update method as described in claim 1, characterized in that, The step of adjusting the positions of all child nodes in the second updated node tree according to the layout relationship between all control elements in the current interface to obtain the current node tree includes: Based on the layout relationship between all control elements in the current interface, determine the structural relationship between all child nodes in the second update node tree; Based on the structural relationship, the positions of all child nodes in the second updated node tree are adjusted until the layout range of the control elements in the current interface gradually shrinks along the path from the root node to any leaf node in the second updated node tree, thus obtaining the current node tree.

4. The background update method as described in claim 1, characterized in that, After obtaining the current node tree corresponding to the current interface, the method further includes: When a user's voice control command for the current interface is received, the voice control command is parsed to determine the target control object corresponding to the voice control command; Based on the target control object, traverse the current node tree to determine the target control element corresponding to the target control object; Based on the attribute information of the target control element, the voice control command is executed in the current interface.

5. The background update method as described in claim 4, characterized in that, The step of executing the voice control command on the current interface based on the attribute information of the target control element includes: The absolute position of the target control element in the current interface is determined based on the position attribute corresponding to the target control element; Based on the absolute position, locate the target control element in the current interface and execute the voice control command on the target control element.

6. A background update device for voice control of a smart TV, characterized in that, The background update device includes: The determination module is used to determine, after listening to the historical interface update of the target application in the smart TV, all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element, wherein, for any control element, the attribute information of the control element includes at least the position attribute of the control element. The first update module is used to update the historical node tree corresponding to the historical interface based on all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element, so as to obtain the current node tree corresponding to the current interface. The current node tree is used to locate the corresponding position of the voice control command in the current interface according to the current node tree when a user's voice control command for the current interface is received, so as to execute the voice control command at the position. The first update module includes: The acquisition unit is used to acquire the historical node tree and update the historical interface represented by the root node of the historical node tree to the current interface. The comparison unit is used to traverse all child nodes in the history node tree starting from the root node of the history node tree, and for any child node in the history node tree, perform a consistency comparison between the control element represented by the child node and all control elements of the current interface. The third update unit is used to retain the child node if there is a control element among all the control elements of the current interface that matches the control element represented by the child node; otherwise, the child node is removed from the historical node tree to obtain the first update node tree. The fourth update unit is used to determine the control elements in the current interface that are not matched. For any control element in the current interface that is not matched, a new child node is created in the first update node tree to represent the control element that is not matched, and the attribute information of the control element that is not matched is associated with the new child node to obtain the second update node tree. The fifth update unit is used to adjust the positions of all child nodes in the second update node tree according to the layout relationship between all control elements in the current interface, so as to obtain the current node tree.

7. The background update device as described in claim 6, characterized in that, The background update device also includes: A listening module is used to listen for update events to the historical interface; The second update module is used to determine the event type of the update event, and update the historical interface according to the event type to obtain the current interface.

8. A television set, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the background update method as described in any one of claims 1 to 5.

9. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by a processor, it implements the steps of the background update method as described in any one of claims 1 to 5.

Images