Background updating method and device for intelligent television voice control, television and medium

Abstract

The invention is suitable for the field of digital televisions, and particularly relates to a background updating method and device for intelligent television voice control, a television and a medium. The method comprises the following steps: after monitoring that a historical interface of a target application in the smart television is updated, updating a historical node tree corresponding to the historical interface according to all control elements in the updated current interface, a layout relationship among all the control elements and attribute information of each control element to obtain a current node tree corresponding to the current interface; the current node tree is used for positioning a position corresponding to a voice control instruction in the current interface according to the current node tree when the voice control instruction of the user for the current interface is received, so as to execute the voice control instruction at the position. The response process of the intelligent television for the voice control instruction of the target application is simplified, and the response speed of the voice control instruction is increased.

Description

Technical Field

[0001] The present invention relates to the field of digital television, and in particular to a background updating method, device, television and medium for voice control of smart television. Background Art

[0002] At present, most smart TVs support voice control. This technology not only provides users with a more convenient operation method, but also improves the intelligent level of user experience through the introduction of artificial intelligence. However, the voice control function of smart TVs still faces some challenges in practical applications. For some smart TVs with voice control function, voice can only control the system applications and self-developed applications of TV manufacturers. If you want voice to control third-party applications, you need to perform complex docking and adaptation. In this process, voice control instructions need to go through multiple intermediate links, including voice recognition, semantic understanding, instruction parsing, application calling, etc. This not only increases the complexity and development cost of the system, but also reduces the response speed, affecting the user experience. Therefore, how to optimize the response process of smart TVs for voice control instructions for applications to improve the response speed has become an urgent problem to be solved. Summary of the invention

[0003] Based on this, a background update method, device, TV and medium for smart TV voice control are provided to solve the problem of optimizing the response process of the smart TV to the voice control instructions of the application to improve the response speed.

[0004] In a first aspect, an embodiment of the present invention provides a background update method for voice control of a smart TV, the background update method comprising the following steps: After monitoring the historical interface update of the target application in the smart TV, determine all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element, wherein for any control element, the attribute information of the control element at least includes the position attribute of the control element; According to all control elements in the current interface, the layout relationship between all control elements and the attribute information of each control element, the historical node tree corresponding to the historical interface is updated to obtain the current node tree corresponding to the current interface; Among them, the current node tree is used to locate the corresponding position of the voice control instruction in the current interface according to the current node tree when receiving the voice control instruction of the user for the current interface, so as to execute the voice control instruction at the position.

[0005] In a second aspect, an embodiment of the present invention provides a background update device for voice control of a smart TV, the background update device comprising: A determination module, configured to determine, after monitoring the update of the historical interface of the target application in the smart TV, all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element, wherein, for any control element, the attribute information of the control element at least includes the position attribute of the control element; A first updating module, configured to update the history node tree corresponding to the history interface according to all control elements in the current interface, the layout relationship between all control elements and the attribute information of each control element, so as to obtain a current node tree corresponding to the current interface; Among them, the current node tree is used to locate the corresponding position of the voice control instruction in the current interface according to the current node tree when receiving the voice control instruction of the user for the current interface, so as to execute the voice control instruction at the position.

[0006] In a third aspect, an embodiment of the present invention provides a television set comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the background update method of the first aspect when executing the computer program.

[0007] In a fourth aspect, an embodiment of the present invention provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the background update method of the first aspect are implemented.

[0008] The technical effect achieved by the present invention is different from that of the prior art: after monitoring the update of the historical interface of the target application in the smart TV, the background update method of the present invention updates the historical node tree corresponding to the historical interface according to all control elements in the updated current interface, the layout relationship between all control elements and the attribute information of each control element, so as to obtain the current node tree corresponding to the current interface; wherein the current node tree is used to locate the corresponding position of the voice control instruction in the current interface according to the current node tree when receiving the user's voice control instruction for the current interface, so as to execute the voice control instruction at the position.

[0009] Among them, after monitoring the historical interface update of the target application, the historical node tree corresponding to the historical interface is updated according to the current interface, and the current node tree corresponding to the current interface is obtained. When the user's voice control command for the current interface is received, the position corresponding to the voice control command can be quickly located according to the current node tree without searching layer by layer in the interface. This simplifies the response process of the smart TV to the voice control command of the target application, improves the response speed to the voice control command, and brings a better voice control experience to the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments of the present invention will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative labor.

[0011] Figure 1 It is a flowchart of a background update method for voice control of a smart TV provided in the first embodiment of the present invention; Figure 2 This is a schematic diagram of the overall process of a background update method for voice control of a smart TV provided in the first embodiment of the present invention; Figure 3 It is a flowchart of a background update method for voice control of a smart TV provided in Embodiment 2 of the present invention; Figure 4 It is a flowchart of a background update method for voice control of a smart TV provided in Embodiment 3 of the present invention; Figure 5 It is a structural diagram of a background updating device for voice control of a smart TV provided by a fourth embodiment of the present invention; Figure 6 It is a structural schematic diagram of a television provided by Embodiment 5 of the present invention. DETAILED DESCRIPTION

[0012] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0013] It should be understood that the order of execution of the steps in the following embodiments does not imply a precedence of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0014] like Figure 1 FIG. 1 is a flow chart of a background update method for voice control of a smart TV provided in Embodiment 1 of the present invention. The method is executed by a processor built into the TV. The background update method may include the following steps: Step S101: after monitoring the historical interface update of the target application in the smart TV, determine all control elements in the updated current interface, the layout relationship between all control elements and the attribute information of each control element.

[0015] In this embodiment, the target application may refer to a third-party application installed in the smart TV, the historical interface may refer to the window interface of the target application displayed in the smart TV before the update, the current interface may refer to the window interface of the target application displayed in the smart TV after the update, the control element may refer to the element used to interact with the user in the current interface, allowing the user to input data, select options or view information, etc., such as buttons, text boxes, drop-down boxes and sliding bars, etc. The layout relationship may refer to the distribution relationship of the control elements in the current interface. For example, for the two control elements of a button and a text box, the layout relationship between the two may be that the button is set in the text box, or the button is set outside the text box, etc. The attribute information may refer to information characterizing the characteristics of the control element, wherein, for any control element, the attribute information of the control element at least includes the position attribute of the control element, and the position attribute is used to characterize the position of the control element in the current interface. For example, the attribute information may include information such as the name, position, and displayed content of the control element.

[0016] Step S102: According to all control elements in the current interface, the layout relationship between all control elements and the attribute information of each control element, the historical node tree corresponding to the historical interface is updated to obtain the current node tree corresponding to the current interface.

[0017] In this embodiment, the historical node tree may refer to a node tree representing the control element information and interface hierarchy of the historical interface, which is obtained based on all control elements in the historical interface, the layout relationship between all control elements, and the attribute information of each control element. The current node tree may refer to a node tree representing the control element information and interface hierarchy of the current interface, which is obtained by updating the historical node tree based on all control elements in the current interface, the layout relationship between all control elements, and the attribute information of each control element. The current node tree is used to locate the corresponding position of the voice control instruction in the current interface according to the current node tree when receiving a voice control instruction from the user for the current interface, so as to execute the voice control instruction at that position.

[0018] Specifically, all nodes in the historical node tree and the structural relationships between all nodes may be updated according to all control elements in the current interface, the layout relationships between all control elements, and the attribute information of each control element to obtain the current node tree.

[0019] Optionally, before monitoring the update of the historical interface of the target application in the smart TV, the update event of the historical interface can also be monitored to determine the event type of the update event, and the historical interface is updated according to the event type to obtain the current interface.

[0020] Among them, the update event may refer to an update operation on the history interface. For example, the update event may be an update operation on the history interface triggered by the user and an automatic jump update of the history interface, etc. The event type of the update event may refer to the specific operation corresponding to the update event, such as click, selection, focus acquisition, text change and other event types.

[0021] Specifically, a corresponding auxiliary class may be created to monitor the update event of the history interface, and according to the event type of the monitored update event, a corresponding operation of updating the history interface is performed to obtain the current interface.

[0022] For example, Figure 2 The figure shows a schematic diagram of the overall process of a background update method provided in the first embodiment of the present application. The target application is a third-party application installed on the TV. According to the third-party application interface, a corresponding node tree can be constructed. The root node in the node tree represents the third-party application interface, and the child node represents the control element in the third-party application interface; This background update service can be created by creating an auxiliary class that inherits from AccessibilityService, and configuring its permissions and service parameters, including monitoring the interface update events of the specified third-party application, the event type to be monitored, the interval time for obtaining the event type, etc., and adding it to the TV's power-on self-start service; 2) In the onAccessibilityEvent method, monitor the update events of the historical interface of the third-party application, and according to the event type of the monitored update event (for example, focus change), perform the corresponding operation to update the historical interface to obtain the current interface; 3) Get all the control elements in the current interface, the layout relationship between all control elements, and each control element attribute information (interface layout); 4) according to all control elements in the current interface, the layout relationship between all control elements and the attribute information of each control element, the historical node tree corresponding to the historical interface is updated to obtain the current node tree corresponding to the current interface; 5) when receiving the user's voice control command for the current interface (for example, "I want to see ×××"), the voice control command is parsed to determine the target control object corresponding to the voice control command, and according to the target control object, the current node tree is traversed (the current interface information of the third-party application is analyzed) to determine the target control element corresponding to the target control object (for example, click node ×××), and according to the attribute information of the target control element, the voice control command is executed in the current interface (for example, simulated click).

[0023] In this embodiment, after monitoring the historical interface update of the target application, the historical node tree corresponding to the historical interface is updated according to the current interface to obtain the current node tree corresponding to the current interface. When the user's voice control command for the current interface is received, the position corresponding to the voice control command can be quickly located according to the current node tree without searching layer by layer in the interface. This simplifies the response process of the smart TV to the voice control command of the target application, improves the response speed to the voice control command, and brings a better voice control experience to the user.

[0024] like Figure 3 As shown, it is a flowchart of a background update method provided by the second embodiment of the present invention. In the above step S102, according to all the control elements in the current interface, the layout relationship between all the control elements and the attribute information of each control element, the historical node tree corresponding to the historical interface is updated to obtain the current node tree corresponding to the current interface, which may include the following steps: Step S301: Obtain a history node tree, and update the history interface represented by the root node of the history node tree to the current interface.

[0025] Step S302: Starting from the root node of the history node tree, traverse all child nodes in the history node tree, and for any child node in the history node tree, compare the control element represented by the child node with all control elements of the current interface for consistency.

[0026] Step S303: If there is a control element among all the control elements of the current interface that is consistent with the control element represented by the child node, the child node is retained; otherwise, the child node is removed from the historical node tree to obtain a first updated node tree.

[0027] Step S304: Determine the control elements that have not been matched consistently in the current interface. For any control element that has not been matched consistently in the current interface, create a new child node in the first update node tree to represent the control element that has not been matched consistently, and associate the attribute information of the control element that has not been matched consistently with the new child node to obtain a second update node tree.

[0028] Step S305: According to the layout relationship between all the control elements in the current interface, the positions of all the child nodes in the second update node tree are adjusted to obtain the current node tree.

[0029] In this embodiment, the first updated node tree may refer to a node tree obtained by updating the historical node tree, and the second updated node tree may refer to a node tree obtained by updating the first updated node tree.

[0030] Specifically, in the process of updating the historical node tree to obtain the current node tree, first, the historical interface represented by the root node of the historical node tree is updated to the current interface, starting from the root node of the historical node tree, all child nodes in the historical node tree are traversed, and for any child node in the historical node tree, the control element represented by the child node is compared with all control elements of the current interface for consistency. If there is a control element among all the control elements of the current interface that is consistent with the control element represented by the child node, the child node is retained. Otherwise, the child node is removed from the historical node tree to obtain the first updated node tree, and then, for any control element in the current interface that is not consistent with the comparison, the child node is removed from the historical node tree to obtain the first updated node tree. Control element, in the first update node tree, create a new child node to represent the unmatched control element, and associate the attribute information of the unmatched control element with the new child node to obtain a second update node tree, and finally, according to the layout relationship between all control elements in the current interface, determine the structural relationship (parent-child relationship, brother relationship) between all child nodes in the second update node tree, and adjust the position of all child nodes in the second update node tree according to the structural relationship until the layout range of the control element in the current interface gradually shrinks on the path from the root node to any leaf node in the second update node tree, and obtain the current node tree.

[0031] In this embodiment, by automatically comparing the control elements of the historical interface and the current interface to update the historical node tree, the changed control elements can be quickly identified, so that the historical node tree can be updated by adding and / or deleting nodes to obtain the current node tree, thereby improving the updating efficiency of the node tree.

[0032] like Figure 4 As shown, a flowchart of a background update method provided by Embodiment 3 of the present invention, after obtaining the current node tree corresponding to the current interface in the above step S102, the following steps may also be included: Step S401: when receiving a voice control instruction from a user for a current interface, the voice control instruction is parsed to determine a target control object corresponding to the voice control instruction.

[0033] Step S402: According to the target control object, traverse the current node tree to determine the target control element corresponding to the target control object.

[0034] Step S403: Execute the voice control instruction in the current interface according to the attribute information of the target control element.

[0035] In this embodiment, the voice control instruction may refer to the voice control instruction of the user for the current interface. For example, the voice control instruction may be clicking a button in the current interface and entering text in a text box in the current interface. The target control object may refer to the control object corresponding to the voice control instruction, and the target control element may refer to the control element corresponding to the target control object in the current interface.

[0036] Specifically, in the process of receiving and executing the user's voice control command for the current interface, first, the voice control command is parsed to determine the target control object corresponding to the voice control command. For example, the voice control command may be "please click on the search box", then it is parsed to determine that the target control object is the search box, and then, based on the target control object, the current node tree is traversed to determine the target control element corresponding to the target control object, and finally, based on the position attribute corresponding to the target control element, the absolute position of the target control element in the current interface (that is, the exact position of the control element relative to the current interface, including the distance in the horizontal and vertical directions) is determined, and based on the absolute position, the target control element is located in the current interface, and the voice control command is executed on the target control element.

[0037] In this embodiment, when a voice control command from the user for the current interface is received, the position corresponding to the voice control command can be quickly located according to the current node tree without searching layer by layer in the interface. This simplifies the response process of the smart TV for the voice control command of the target application, improves the response speed to the voice control command, and brings a better voice control experience to the user.

[0038] like Figure 5 As shown, it is a structural diagram of a background update device for voice control of a smart TV provided in the fourth embodiment of the present application. The background update device corresponds one-to-one with the background update method in the above embodiment. The background update device includes a determination module 51 and a first update module 52. The functional modules are described in detail as follows: A determination module 51 is used to determine all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element after monitoring the historical interface update of the target application in the smart TV, wherein for any control element, the attribute information of the control element at least includes the position attribute of the control element; A first updating module 52, configured to update the history node tree corresponding to the history interface according to all control elements in the current interface, the layout relationship between all control elements and the attribute information of each control element, so as to obtain a current node tree corresponding to the current interface; Among them, the current node tree is used to locate the corresponding position of the voice control instruction in the current interface according to the current node tree when receiving the voice control instruction of the user for the current interface, so as to execute the voice control instruction at the position.

[0039] Optionally, the background updating device further includes: A monitoring module, used for monitoring update events of the history interface; The second updating module is used to determine the event type of the update event, and update the historical interface according to the event type to obtain the current interface.

[0040] Optionally, the first updating module 52 includes: An acquisition unit, configured to acquire the history node tree, and update the history interface represented by the root node of the history node tree to the current interface; A comparison unit, configured to start from the root node of the history node tree, traverse all child nodes in the history node tree, and for any child node in the history node tree, compare the control element represented by the child node with all control elements of the current interface for consistency; A third updating unit is configured to retain the child node if there is a control element among all the control elements of the current interface that is consistent with the control element represented by the child node, and otherwise, remove the child node from the historical node tree to obtain a first updated node tree; A fourth updating unit is used to determine the control elements in the current interface that are not matched consistently, and for any control element in the current interface that is not matched consistently, create a new child node in the first update node tree to represent the control element that is not matched consistently, and associate the attribute information of the control element that is not matched consistently with the new child node to obtain a second update node tree; The fifth updating unit is used to adjust the positions of all child nodes in the second updated node tree according to the layout relationship between all control elements in the current interface to obtain the current node tree.

[0041] Optionally, the fifth updating unit includes: A structure determination subunit, used to determine the structural relationship between all child nodes in the second update node tree according to the layout relationship between all control elements in the current interface; The structure adjustment sub-unit is used to adjust the positions of all child nodes in the second update node tree according to the structural relationship until the layout range of the control elements in the current interface gradually shrinks on the path from the root node to any leaf node in the second update node tree, thereby obtaining the current node tree.

[0042] Optionally, the background updating device further includes: A parsing module, configured to parse a voice control instruction from a user for the current interface and determine a target control object corresponding to the voice control instruction when receiving the voice control instruction from the user for the current interface; A traversal module, used to traverse the current node tree according to the target control object, and determine the target control element corresponding to the target control object; An execution unit is used to execute the voice control instruction in the current interface according to the attribute information of the target control element.

[0043] Optionally, the above-mentioned execution unit includes: A position determination subunit, used to determine the absolute position of the target control element in the current interface according to the position attribute corresponding to the target control element; A position positioning subunit is used to locate the target control element in the current interface according to the absolute position, and execute the voice control instruction on the target control element.

[0044] For the specific definition of the background update device, please refer to the definition of the background update method above, which will not be repeated here. Each module in the above-mentioned background update device can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the TV in the form of hardware, or can be stored in the memory in the TV in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0045] Figure 6 This is a schematic diagram of the structure of a television set provided by Embodiment 5 of the present invention. Figure 6 As shown, the television set of this embodiment includes: at least one processor ( Figure 6 Only one is shown in the figure), a memory, and a computer program stored in the memory and executable on at least one processor, wherein when the processor executes the computer program, the steps of any of the above-mentioned background update method embodiments are implemented.

[0046] The television may include, but is not limited to, a processor and a memory. Those skilled in the art will appreciate that Figure 6 This is merely an example of a television and does not constitute a limitation on the television. A television may include more or fewer components than shown in the figure, or a combination of certain components, or different components, for example, it may also include a network interface, a display screen, and an input device.

[0047] The processor may be a central processing unit (CPU), other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. A general-purpose processor may be a microprocessor or any conventional processor, etc.

[0048] The memory includes a readable storage medium, an internal memory, etc., wherein the internal memory may be the memory of the television, and the internal memory provides an environment for the operation of the operating system and computer-readable instructions in the readable storage medium. The readable storage medium may be the hard disk of the television, and in other embodiments, it may also be an external storage device of the television, for example, a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped on the television. Further, the memory may also include both an internal storage unit of the television and an external storage device. The memory is used to store an operating system, an application program, a boot loader (BootLoader), data, and other programs, such as the program code of a computer program, etc. The memory may also be used to temporarily store data that has been output or is to be output.

[0049] The technicians in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional units and modules is used as an example. In practical applications, the above-mentioned function allocation can be completed by different functional units and modules as needed, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiment can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the scope of protection of the present invention. The specific working process of the units and modules in the above-mentioned device can refer to the corresponding process in the above-mentioned method embodiment, which will not be repeated here. If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on such understanding, the present invention implements all or part of the processes in the above-mentioned embodiment method, which can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a computer-readable storage medium. When the computer program is executed by the processor, the steps of the above-mentioned method embodiment can be implemented. Among them, the computer program includes computer program code, and the computer program code can be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying computer program code, recording medium, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. For example, a USB flash drive, a mobile hard disk, a magnetic disk or an optical disk. In some jurisdictions, according to legislation and patent practice, computer-readable media cannot be electric carrier signals and telecommunication signals.

[0050] The present invention implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by a computer program product. When the computer program product runs on a television, the television can implement the steps in the above-mentioned method embodiment when executing the computer program product.

[0051] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described or recorded in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0052] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0053] In the embodiments provided by the present invention, it should be understood that the disclosed device / television and method can be implemented in other ways. For example, the device / television embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0054] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0055] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features can be replaced by equivalents, and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. A background update method for smart TV voice control, characterized in that: The background update method comprises the following steps: After monitoring the historical interface update of the target application in the smart TV, determine all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element, wherein for any control element, the attribute information of the control element at least includes the position attribute of the control element; According to all control elements in the current interface, the layout relationship between all control elements and the attribute information of each control element, the historical node tree corresponding to the historical interface is updated to obtain the current node tree corresponding to the current interface; The current node tree is used to locate the position corresponding to the voice control instruction in the current interface according to the current node tree when receiving a voice control instruction from the user for the current interface, so as to execute the voice control instruction at the position.

2. The background update method according to claim 1, characterized in that: Before monitoring the historical interface update of the target application in the smart TV, the method further includes: Listening for update events of the history interface; An event type of the update event is determined, and according to the event type, the historical interface is updated to obtain the current interface.

3. The background update method according to claim 1, characterized in that: The updating of the history node tree corresponding to the history interface according to all the control elements in the current interface, the layout relationship between all the control elements and the attribute information of each control element to obtain the current node tree corresponding to the current interface includes: Acquire the history node tree, and update the history interface represented by the root node of the history node tree to the current interface; Starting from the root node of the history node tree, traverse all child nodes in the history node tree, and for any child node in the history node tree, compare the control element represented by the child node with all control elements of the current interface for consistency; If there is a control element among all the control elements of the current interface that is consistent with the control element represented by the child node, the child node is retained; otherwise, the child node is removed from the historical node tree to obtain a first updated node tree; Determine the control elements in the current interface that are not matched consistently, and for any control element in the current interface that is not matched consistently, create a new child node in the first update node tree to represent the control element that is not matched consistently, and associate the attribute information of the control element that is not matched consistently with the new child node to obtain a second update node tree; According to the layout relationship between all the control elements in the current interface, positions of all the child nodes in the second update node tree are adjusted to obtain the current node tree.

4. The background update method according to claim 3, characterized in that: The step of adjusting the positions of all child nodes in the second update node tree according to the layout relationship between all control elements in the current interface to obtain the current node tree includes: Determining the structural relationship between all child nodes in the second update node tree according to the layout relationship between all control elements in the current interface; According to the structural relationship, positions of all child nodes in the second update node tree are adjusted until the layout range of control elements in the current interface gradually shrinks on the path from the root node to any leaf node in the second update node tree, thereby obtaining the current node tree.

5. The background update method according to claim 1, characterized in that: After obtaining the current node tree corresponding to the current interface, the method further includes: When receiving a voice control instruction from a user for the current interface, parsing the voice control instruction to determine a target control object corresponding to the voice control instruction; According to the target control object, traverse the current node tree to determine the target control element corresponding to the target control object; According to the attribute information of the target control element, the voice control instruction is executed in the current interface.

6. The background update method according to claim 5, characterized in that: The executing the voice control instruction in the current interface according to the attribute information of the target control element and the control type includes: Determining the absolute position of the target control element in the current interface according to the position attribute corresponding to the target control element; According to the absolute position, the target control element is located in the current interface, and the voice control instruction is executed on the target control element.

7. A background update device for voice control of smart TV, characterized in that: The background updating device comprises: A determination module, configured to determine, after monitoring the update of the historical interface of the target application in the smart TV, all control elements in the updated current interface, the layout relationship between all control elements, and the attribute information of each control element, wherein, for any control element, the attribute information of the control element at least includes the position attribute of the control element; A first updating module, configured to update the history node tree corresponding to the history interface according to all control elements in the current interface, the layout relationship between all control elements and the attribute information of each control element, so as to obtain a current node tree corresponding to the current interface; Among them, the current node tree is used to locate the corresponding position of the voice control instruction in the current interface according to the current node tree when receiving the voice control instruction of the user for the current interface, so as to execute the voice control instruction at the position.

8. The background updating device according to claim 7, characterized in that: The background updating device also includes: A monitoring module, used for monitoring update events of the history interface; The second updating module is used to determine the event type of the update event, and update the historical interface according to the event type to obtain the current interface.

9. A television set comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the background update method according to any one of claims 1 to 6 are implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the background update method according to any one of claims 1 to 6 are implemented.

Images