Display device and plan making method

Abstract

According to the display device and the plan making method, the display device responds to the first instruction of making the first plan indicated by the user, the instruction content of the first instruction can be analyzed, and the user intention, the first user information and the first requirement of the user for the first plan are accurately obtained. The display device can screen out the first historical task set matched with the first instruction from the historical task set and adjust the first historical task set according to the user intention, the first user information and the first requirement so as to quickly obtain the target task set capable of being matched with the plan needing to be made this time. Therefore, the workload and time consumption of task planning are reduced, the efficiency of obtaining the target task set is improved, and then the efficiency of formulating the first plan can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for formulating a plan. Background Art

[0002] Display devices refer to terminal devices that can output specific display images, which can be terminal devices such as smart TVs, mobile terminals, smart advertising screens, projectors, etc. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.

[0003] The display device may be configured with a plan-making function. Based on this function, when the user wants to make a plan, he or she may input the requirements for the plan to be made to the display device. The display device needs to plan the tasks to be performed according to these requirements and perform these tasks. The display device summarizes the execution results of each task and can obtain a corresponding plan.

[0004] Based on the above planning process, it can be seen that as the user's requirements increase, the process of the display device planning the tasks to be performed becomes more complicated and time-consuming, and the more tasks to be performed are planned, the longer it takes to perform the tasks. It can be seen that the efficiency of the display device in making plans is low, which will result in the user having to wait longer from inputting requirements to obtaining plans, and a poor experience. Summary of the invention

[0005] The present application provides a display device and a plan formulation method, which can quickly obtain a target task set that matches the plan to be formulated this time by adjusting the historical task set, so as to improve the efficiency of plan formulation.

[0006] In a first aspect, the present application provides a display device, comprising: a controller, configured to: respond to a first instruction instructed by a user to formulate a first plan, and obtain user intent, first user information and at least one first requirement of the user for the first plan according to the instruction content of the first instruction; obtain at least one historical task set, the historical task set corresponding to the historical instruction instructed by the user to formulate a corresponding plan; filter out a first historical task set that matches the first instruction from the at least one historical task set; adjust the tasks in the first historical task set according to the user intent, the first user information and the at least one first requirement to obtain a target task set; call a target tool corresponding to each task in the target task set, and execute the corresponding task through the target tool to obtain the first plan; and display the first plan.

[0007] The above technical solution has the following beneficial effects or advantages:

[0008] In response to the first instruction of the user indicating to formulate the first plan, the display device can analyze the instruction content of the first instruction to accurately obtain the user's intention, the first user information and the first requirement of the user for the first plan. The display device can first filter out the first historical task set that matches the first instruction from the historical task set, and adjust the first historical task set according to the user's intention, the first user information and the first requirement to quickly obtain the target task set that can match the first plan, thereby reducing the workload and time consumption of planning tasks, improving the efficiency of obtaining the target task set, and further improving the efficiency of formulating the first plan.

[0009] In some embodiments of the present application, the controller executes a first instruction to formulate a first plan in response to a user's instruction, and obtains user intent, user information, and at least one first requirement of the user for the first plan based on the instruction content of the first instruction. It is specifically configured as follows: according to the instruction content of the first instruction, obtaining the user intent; and according to the user intent, extracting the first user information and the at least one first requirement from the first text.

[0010] The above technical solution has the following beneficial effects or advantages:

[0011] The display device can ensure that the extracted first user information and first requirement are in accordance with the user's intention by extracting the first user information and the first requirement corresponding to the user's intention from the instruction content of the first instruction, thereby ensuring that the target task set subsequently obtained based on the first user information and the first requirement can meet the user's intention. In addition, the display device can effectively filter out other information in the first text and reduce the amount of data of the extracted information by extracting the first user information and the first requirement according to the user's intention, thereby improving the data processing efficiency of obtaining the target task set based on the first user information and the first requirement, thereby further improving the efficiency of formulating the first plan.

[0012] In some embodiments of the present application, the controller executes a first instruction to formulate a first plan in response to a user's instruction, and obtains the user's intention, first user information, and at least one first requirement of the user for the first plan based on the instruction content of the first instruction. The controller is specifically configured as follows: if the instruction content of the first instruction does not include the first user information, when the first instruction is a voice instruction, obtain the voice features corresponding to the first instruction; and obtain the first user information based on the voice features.

[0013] The above technical solution has the following beneficial effects or advantages:

[0014] When the instruction content of the first instruction does not include the first user information and the first instruction is a voice instruction, the display device can combine the sound analysis technology to obtain the first user information based on the voice characteristics of the first instruction, thereby ensuring the integrity of the information used to obtain the target task set, and further ensuring the accuracy of the target task set.

[0015] In some embodiments of the present application, the controller executes a first instruction to formulate a first plan in response to a user's instruction, obtains user intent, first user information, and at least one first requirement of the user for the first plan based on the instruction content of the first instruction, and is also configured to: obtain summary information corresponding to the historical instructions, the summary information being used to characterize specified dimensions of the historical instructions; filter out target summary information that matches the instruction content of the first instruction from the summary information; and update the first user information based on the target summary information.

[0016] The above technical solution has the following beneficial effects or advantages:

[0017] After obtaining the first user information, the display device can use the summary information corresponding to the historical instructions as auxiliary information to update the first user information. Since the summary information can represent the historical interaction between the user and the display device, and the historical interaction between the user and the display device can also reflect the user's preferences, habits, needs, etc. in certain dimensions. Therefore, the updated first user information can more accurately reflect the user's preferences, habits, needs, etc., and can further improve the accuracy of the target task set obtained based on the updated first user information.

[0018] In some embodiments of the present application, the controller executes filtering out a first historical task set that matches the first instruction from the at least one historical task set, and is specifically configured to: obtain the historical instructions corresponding to each of the historical task sets in the at least one historical task set; match the first instruction with each of the historical instructions, and / or match the first instruction with the tasks in each of the historical task sets to obtain a matching result; based on the matching result, filter out the first historical task set from the at least one historical task set, wherein the matching result corresponding to the first historical task set satisfies the first matching result and / or the second matching result, the first matching result being that the first instruction matches the historical instruction corresponding to the first historical task set, and the second matching result being that the task in the first historical task set matches the at least one first requirement corresponding to the first instruction.

[0019] The above technical solution has the following beneficial effects or advantages:

[0020] The display device can accurately filter out a first historical task set that can match the first instruction from the historical task set by matching the first instruction with historical instructions and / or matching the first instruction with tasks in the historical task set. The first historical task set has relatively few tasks that need to be adjusted, which can effectively improve the efficiency of subsequently obtaining the target task set, thereby improving the efficiency of formulating the first plan.

[0021] In some embodiments of the present application, the controller executes adjustment of tasks in the first historical task set according to the user intention, the first user information and the at least one first requirement to obtain the target task set, and is specifically configured as follows: filtering out a first task from the tasks included in the first historical task set, and the first task does not match at least one of the user intention, the first user information and the at least one first requirement; filtering out a requirement to be planned from the at least one first requirement, and the requirement to be planned does not match any of the tasks in the first historical task set; adjusting the first task according to the user intention, the first user information and the mismatched information in the at least one first requirement, and adding a second task corresponding to the requirement to be planned in the first historical task set to obtain the target task set.

[0022] The above technical solution has the following beneficial effects or advantages:

[0023] The display device can obtain tasks that can accurately match the user intention, the first user information, and each first requirement by adjusting the first task in the first historical task set that does not match the user intention, the first user information, and the first requirement, and adding the second task corresponding to the requirement to be planned in the first historical task set, wherein the first user information may include user information directly extracted from the instruction content of the first instruction, user information obtained based on the voice feature of the first instruction, and user information updated according to the summary information corresponding to the historical instruction. Therefore, the target task set formed by these tasks can accurately match the user intention, the first user information, and the tasks of each first requirement.

[0024] In some embodiments of the present application, the controller adjusts the tasks in the first historical task set according to the user intention, the first user information and the at least one first requirement to obtain a target task set, and is also configured to: obtain tool information of available tools; and add a third task to the first historical task set according to the tool information of the available tools, and the third task has the corresponding available tool.

[0025] The above technical solution has the following beneficial effects or advantages:

[0026] The display device may be configured with tools for executing corresponding tasks. When planning the task this time, planning may be performed based on the tools available among these tools to ensure planning efficiency, improve the richness of the planned tasks, and ensure the executability of the planned tasks.

[0027] In some embodiments of the present application, the controller adjusts the tasks in the first historical task set according to the user intention, the first user information and the at least one first requirement to obtain the target task set, and is also configured to: obtain the associated tasks of the user intention; obtain a fourth task in the associated tasks that is different from the tasks in the first historical task set; and add the fourth task to the first historical task set to obtain the target task set.

[0028] The above technical solution has the following beneficial effects or advantages:

[0029] The display device can directly add the associated tasks intended by the user to the first historical task set to automatically expand the content that the user may need and formulate a first plan with richer content.

[0030] In some embodiments of the present application, the controller executes a call to a target tool corresponding to each task in the target task set, and executes the corresponding task through the target tool to obtain the first plan, and is specifically configured as follows: obtaining the first category of tasks and the second category of tasks in the target task set, the first category of tasks corresponding to the unadjusted tasks in the first historical task set, and the second category of tasks corresponding to the tasks in the target task set other than the first category of tasks; if the first historical task set includes execution results corresponding to each task, obtaining the execution results corresponding to the first category of tasks from the first historical task set; calling the target tool corresponding to the second category of tasks, and executing the corresponding second category of tasks through the target tool to obtain the execution results of the second category of tasks; the execution results corresponding to the first category of tasks and the execution results of the second category of tasks constitute the first plan.

[0031] The above technical solution has the following beneficial effects or advantages:

[0032] When the display device executes the tasks in the target task set, it can directly use the execution results of the first type of tasks and only needs to execute the second type of tasks, thereby effectively reducing the number of tasks that actually need to be executed and improving the overall efficiency of executing tasks.

[0033] In a second aspect, the present application also provides a plan formulation method, which is applied to a display device as described in any one of the first aspects, and the method includes: responding to a first instruction of a user to formulate a first plan, and obtaining a user intention, first user information and at least one first requirement of the user for the first plan according to the instruction content of the first instruction; obtaining at least one historical task set, and the historical task set corresponds to the historical instruction of the user to formulate a corresponding plan; filtering out a first historical task set that matches the first instruction from the at least one historical task set; adjusting the tasks in the first historical task set according to the user intention, the first user information and the at least one first requirement to obtain a target task set; calling the target tool corresponding to each task in the target task set, and executing the corresponding task through the target tool to obtain the first plan; and displaying the first plan.

[0034] The above technical solution has the following advantages or beneficial effects:

[0035] In response to the first instruction of the user indicating to formulate the first plan, the display device can analyze the instruction content of the first instruction to accurately obtain the user's intention, the first user information and the first requirement of the user for the first plan. The display device can first filter out the first historical task set that matches the first instruction from the historical task set, and adjust the first historical task set according to the user's intention, the first user information and the first requirement to quickly obtain the target task set that can match the first plan, thereby reducing the workload and time consumption of planning tasks, improving the efficiency of obtaining the target task set, and further improving the efficiency of formulating the first plan. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0037] Figure 1 A schematic diagram of an operation scenario between a display device 200 and a control device 100 in an embodiment of the present application;

[0038] Figure 2 It is a hardware configuration block diagram of the display device 200 in the embodiment of the present application;

[0039] Figure 3 This is a configuration diagram of an operating system of a display device 200 in an embodiment of the present application;

[0040] Figure 4 A flowchart of formulating a first plan for the display device 200 in an embodiment of the present application;

[0041] Figure 5 This is a schematic diagram of the architecture planned to be formulated in the embodiments of the present application;

[0042] Figure 6 A timing diagram for formulating a first plan for the display device 200 in an embodiment of the present application;

[0043] Figure 7 A flowchart of the display device 200 acquiring the user intention, the first user information and the first requirement in the embodiment of the present application;

[0044] Figure 8 A flowchart of the display device 200 updating the first user information in an embodiment of the present application;

[0045] Fig. 9 A flowchart of the display device 200 screening a first historical task set in an embodiment of the present application;

[0046] Fig.10 A flowchart of adjusting a first historical task set of the display device 200 in an embodiment of the present application;

[0047] Fig.11 A schematic diagram of the structure of the tool library provided in the embodiment of the present application;

[0048] Fig.12 This is a flow chart of the display device 200 planning tasks according to the tool library in an embodiment of the present application;

[0049] Fig.13 This is a flow chart showing that the display device 200 plans tasks according to associated tasks in an embodiment of the present application;

[0050] Fig.14 A flowchart of a task performed by the display device 200 in an embodiment of the present application;

[0051] Fig.15 This is an interactive schematic diagram of the display device 200 formulating a fitness plan for a user in an embodiment of the present application. DETAILED DESCRIPTION

[0052] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0053] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0054] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0055] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0056] In the embodiments of the present application, the display device generally refers to a device with image display and data processing capabilities. For example, the display device includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0057] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, voice, mobile terminal 300 and control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0058] like Figure 1 It is also shown that the display device 200 also communicates data with the server 400 (also referred to as the cloud or cloud server) through various communication methods. The display device 200 may be allowed to communicate and connect via a local area network (LAN), a wireless local area network (WLAN) and other networks.

[0059] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0060] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0061] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a user input interface 280, a memory, and a power supply.

[0062] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. The communication device 220 may enable the display device 200 to communicate with an external device or server 400 by wireless or wired connection.

[0063] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0064] In some embodiments, the device interface 240 is used to access an external device.

[0065] In some embodiments, the controller 250 is used to control the overall operation of the display device 200. The controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory.

[0066] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0067] In some embodiments, the display 260 is used to receive and display image signals outputted from the controller 250. The display 260 may include a display function component for presenting images, and a driving component for driving image display.

[0068] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface 280 may receive the user command through the GUI.

[0069] In some embodiments, the audio output device 270 may be a local speaker of the display device 200 , or may be an external audio output device of the display device 200 .

[0070] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0071] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0072] The operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device 200 .

[0073] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system can be divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system runtime layer and the kernel layer.

[0074] In some embodiments, the application layer is used to provide services and interfaces for the application so that the display device 200 can run the application and interact with the user based on the application. For example, the application layer may include a voice assistant, which provides a voice interaction function, and the user can interact with the display device through the voice assistant in a voice manner.

[0075] The framework layer can provide application programming interfaces (API) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center, which determines the actions of applications in the application layer. Applications can access system resources and obtain system services during execution through the API interface.

[0076] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0077] In some embodiments, the kernel layer is a functional level between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management.

[0078] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0079] The display device 200 may be configured with a plan-making function. Based on this function, when the user wants to make a plan, he can input the requirements for the plan to be made to the display device 200. The display device 200 needs to plan the tasks to be performed according to these requirements and perform these tasks. The display device 200 summarizes the execution results of each task and can obtain a corresponding plan.

[0080] Based on the above plan-making process, it can be seen that as the user makes more requirements, the process of the display device 200 planning the tasks to be executed becomes more complicated and time-consuming, and the more tasks to be executed are planned, the longer it takes to execute the tasks. It can be seen that the efficiency of the display device 200 in making plans is low, which will result in the user having to wait longer from inputting requirements to obtaining plans, and a poor experience.

[0081] In order to solve the above problems, the display device 200 provided in the embodiment of the present application can be configured to quickly obtain a target task set that matches the plan to be formulated this time by adjusting the historical task set, thereby improving the efficiency of planning.

[0082] In the embodiment of the present application, the function of making a plan configured by the display device 200 can be used to make various types of plans, that is, it is a universal function. The function of making a plan configured by the display device 200 can be used to make a specified type of plan, that is, a personalized function configured for a specific application. For example, the function of making a plan configured by the display device 200 can be a function configured for a fitness application, which is used to make a fitness type plan.

[0083] In some embodiments, the display device 200 may be installed with an assistant (Agent) application (also referred to as an agent application), and the assistant application provides a plan-making function. Taking the plan-making function as a function configured for a fitness application as an example, the assistant application may be a fitness application. Among them, the assistant application may provide one or more assistant services (also referred to as agent services).

[0084] Figure 4The flowchart of formulating the first plan for the display device 200 in the embodiment of the present application, the specific steps are as follows:

[0085] Step S401: In response to a first instruction from a user to formulate a first plan, the user intention, first user information and at least one first requirement of the user for the first plan are obtained according to the instruction content of the first instruction.

[0086] When the user wants to make a plan, the user may indicate a first instruction to make a first plan to the display device 200 , wherein the first plan is the plan that the user wants to make this time.

[0087] In some embodiments, the first instruction may be a non-voice instruction. In one example, the display device 200 may display a plan-making page in response to a user's control instruction, and the plan-making page may include one or a combination of input boxes, selection items, scroll items, etc. Among them, the input box can be used to input the instruction content of the first instruction; the contents corresponding to the selection items and the scroll items can all be used as instruction contents. The display device 200 may respond to the first instruction input by the user based on the generation item in the plan-making page or the confirmation key on the control device 100, determine that the first instruction is used to instruct the formulation of the first plan, and obtain the information corresponding to the input box, selection items, scroll items, etc., and use the information as the instruction content of the first instruction.

[0088] In some embodiments, the first instruction may be a voice instruction. In one example, the display device 200 may support a far-field voice function. The display device 200 may switch to a wake-up state in response to a wake-up word input by a user, and in the wake-up state, the display device 200 may perform voice interaction with the user through an assistant application. In the wake-up state, the display device 200 may respond to the first instruction spoken by the user, and may convert the first instruction into text data, which is the instruction content of the first instruction.

[0089] In the embodiment of the present application, after receiving the first instruction, the display device 200 can execute the task of making a plan through the large model.

[0090] In some embodiments, the big model can be integrated on the display device 200 side, that is, the big model is a local model, and the display device 200 can perform the planning task locally.

[0091] Combination Figure 3 The operating system shown can configure an assistant application at the application layer for interacting with the user; can configure an assistant framework at the framework layer, which is used to provide the infrastructure and operating environment, for example, it can support assistant services; can configure a large model at the system runtime layer, and the large model executes the planned tasks by interacting with the components / modules / services supported by the assistant framework.

[0092] In some embodiments, the big model can be integrated on the server 400 side, that is, the big model is a cloud model, and the display device 200 needs to transmit the first instruction to the cloud model and receive the result of executing the planned task returned by the cloud model.

[0093] Combination Figure 5 As shown in the architecture diagram, the display device 200 can be configured with an assistant application, and the server 400 can be configured with an assistant framework and a large model. Among them, the assistant application has the function of transmitting the first instruction input by the user to the server 400. For example, the communication device 220 of the display device 200 can be called to send the first instruction to the server 400. The assistant framework and the large model in the server 400 can refer to the above description of the assistant framework and the large model integrated in the operating system, which will not be repeated here.

[0094] The display device 200 can input the instruction content of the first instruction as input data into the big model, and the big model analyzes the instruction content and outputs the user intention, the first user information, and the user's first requirement for the first plan. In other words, the display device 200 uses the big model to obtain the user intention, the first user information, and the user's first requirement for the first plan.

[0095] If the first instruction is a voice instruction, the voice recognition module configured by the display device 200 can convert the first instruction into text data, and then input the text data into the large model. Alternatively, if the large model is integrated with a voice recognition (Automatic Speech Recognition, ASR) function, the first instruction can be directly input into the large model, and the large model can convert it into text data by itself.

[0096] The large model is integrated with a natural language processing (NLP) function, which can perform semantic understanding on the instruction content of the first instruction, and determine the user intention reflected by the instruction content, the first user information and the first requirement contained in the instruction content.

[0097] The user intention may indicate the type of plan that the user wants to make, that is, the type of the first plan. For example, if the user intention is fitness intention, it means that the first plan is a fitness plan.

[0098] The first user information may include basic information of the user, such as age, gender, height, weight, health status, etc.

[0099] The user's first requirement for the first plan, where the first requirement is the basic requirement that the first plan needs to meet, such as time, purpose, location, etc.

[0100] The instruction content of the first instruction may include one or more first requirements. If one first requirement is included, or the number of first requirements is less than or equal to n (n is a positive integer greater than 1), it means that the instruction content of the first instruction is relatively simple; if multiple first requirements are included or the number of first requirements is greater than n, it means that the instruction content of the first instruction is relatively complex. It can be understood that the display device 200 can formulate corresponding first plans for both simple and complex first instructions.

[0101] Figure 6 A timing diagram of a first plan is formulated for the display device 200 in the embodiment of the present application.

[0102] Combination Figure 6 , the display device 200 interacts with the user through the assistant application. After the display device 200 receives the first instruction input by the user through the assistant application, the assistant application sends / transmits the first instruction to the assistant service in the assistant framework, and the assistant service inputs the instruction content of the first instruction into the big model. The big model outputs the user intention, the first user information and the first requirement.

[0103] Figure 7 This is a flow chart of the display device 200 acquiring the user intention, the first user information and the first requirement in the embodiment of the present application, and the specific steps include:

[0104] Step S701: Obtain user intention according to the instruction content of the first instruction.

[0105] The display device 200 may use the macro model to obtain the user's intention.

[0106] Step S702: extracting first user information and at least one first requirement from the first text according to the user intention.

[0107] The instruction content of the first instruction may contain information that is irrelevant to the user's intention, for example, user information and requirements that are irrelevant to the user's intention. The display device 200 can use the large model to extract the first user information and at least one first requirement related to the user's intention from the instruction content of the first instruction, thereby ensuring that the extracted first user information and first requirement can meet the user's intention, and then ensuring that the target task set subsequently obtained based on the first user information and the first requirement can meet the user's intention. In addition, other information in the first text can be effectively filtered out, and the amount of data of the extracted information can be streamlined, thereby improving the data processing efficiency of the target task set obtained based on the first user information and the first requirement, and further improving the efficiency of formulating the first plan.

[0108] The first user information will affect the matching degree between the target task set generated subsequently and the basic information of the user, that is, it will affect the accuracy of the target task set. Among them, the higher the completeness of the first user information, the higher the accuracy of the target task set generated subsequently; the lower the completeness of the first user information, or the lack of the first user information, the lower the accuracy of the target task set generated subsequently. Taking the first user information including gender information as an example, if the instruction information includes gender information, tasks matching the gender information can be planned. For example, if the gender information is female, when planning the task of finding fitness forms, tasks matching girls can be planned, such as small strength fitness forms, flexible fitness forms, etc. If the instruction information does not include gender information, when planning tasks, it will not be possible to accurately plan tasks matching the actual gender of the user. For example, if the user's real gender is male, when planning the task of finding fitness forms, since the user's gender information is not mastered, it is impossible to accurately plan tasks matching the user's real gender. It is possible that flexible fitness forms and other fitness forms that are not suitable for boys are planned for the user, resulting in inaccurate planned tasks.

[0109] If the instruction content of the first instruction does not include the first user information, in order to improve the accuracy of subsequently generating the target task set, the display device 200 actively obtains the first user information.

[0110] In some embodiments, if the first instruction is a voice instruction, the display device 200 obtains a voice feature corresponding to the first instruction, and obtains the first user information according to the voice feature.

[0111] In one example, the display device 200 may be integrated with a sound analysis / processing module, which may be used to obtain the voice features corresponding to the voice data. Thus, the display device 200 may obtain the voice features corresponding to the voice command through the module.

[0112] In one example, the large model may be integrated with a sound analysis / processing function, which may be used to obtain the voice features corresponding to the voice data, or the assistant framework may support a sound analysis / processing service, and the large model may obtain the voice features corresponding to the voice data by calling the service. Thus, the display device 200 may use the large model to obtain the voice features corresponding to the voice command.

[0113] In some embodiments, the voice feature can be used to analyze the first user information of the corresponding user. The voice feature can include one or a combination of voiceprint features, frequency features, timbre features, intonation features, energy features, etc. It is understood that the voice feature is not limited to the above disclosed features.

[0114] The first user information of the user may be analyzed based on the voice features, for example, the user's gender, emotion, health status, etc. may be determined.

[0115] In other embodiments, the display device 200 may display inquiry information to prompt the user to input corresponding user information according to the inquiry information, and the display device 200 determines the user information input by the user as the first user information.

[0116] The first user information extracted from the instruction content of the first instruction, or the first user information obtained based on the query information, has certain limitations and is likely to affect the accuracy of the target task set obtained subsequently. In order to solve the above problem, the display device 200 can actively obtain some auxiliary information to update the first user information through the auxiliary information, thereby improving the richness and accuracy of the first user information.

[0117] In some embodiments, if the display device 200 is configured with a positioning function, for example, the display device 200 is configured with a positioning module, the display device 200 can obtain the current positioning information in response to the first instruction, and can update the first user information according to the positioning information, for example, add the positioning information to the first user information. In this way, when planning a task according to the updated first user information, the planning can be performed according to the positioning information therein.

[0118] In some embodiments, the display device 200 may be configured to record historical interaction information between the user and the display device 200 when the user uses the function of making plans on the display device 200, and the historical interaction information may reflect the user's habits, preferences, interests, etc. More specifically, the historical interaction information may reflect the user's habits, preferences, interests, etc. when making different types of plans.

[0119] Before making the first plan this time, the historical interaction information generated by the user making plans and the display device 200 can also be called historical instructions. The description of historical instructions can refer to the description of the first instruction above, which will not be repeated here.

[0120] The display device 200 can use relevant information extraction models, classification models, labeling models, etc. to obtain summary information corresponding to each historical instruction. The summary information is used to characterize the specified dimension of the corresponding historical instruction, and the specified dimension may include the summary of the historical instruction, key information, the user's personality, interests, etc. Correspondingly, the summary information may include the summary information of the historical instruction, the key information of the historical instruction, the theme of the historical instruction, the theme of the historical instruction, the personality tag corresponding to the historical instruction, the interest tag corresponding to the historical instruction, etc., that is, the summary information may reflect the focus and outline of the specific conversation data when the user makes a historical plan, the theme (also known as the type) of the plan, the user's personality, the user's interests, etc.

[0121] The display device 200 can store summary information, key events, themes, etc. in the summary information into a vector library, and store personality tags, interest tags, etc. into a tag library. Among them, the display device 200 can store the summary information (also referred to as new summary information) corresponding to the instruction each time it receives an instruction input by the user to make a plan. When the display device 200 stores new summary information, it will use the new summary information to update the stored summary information. For example, directly add new summary information, merge the new summary information with the stored summary information, delete the new summary information, etc.

[0122] In some embodiments, in combination Figure 5 ,The assistant framework can also support a memory module, and the memory module performs the task of storing ,summary information of historical instructions.

[0123] In some embodiments, the display device 200 may use the summary information as auxiliary information to update the first user information.

[0124] Figure 8 This is a flow chart of the display device 200 updating the first user information in an embodiment of the present application, and the specific steps are as follows:

[0125] Step S801: Obtain summary information corresponding to historical instructions.

[0126] The display device 200 may obtain summary information corresponding to each historical instruction from the corresponding library.

[0127] Step S802: Filter out target summary information that matches the instruction content of the first instruction from the summary information.

[0128] The types of plans indicated by the historical instructions are different, and the display device 200 needs to filter out target summary information that matches the instruction content of the first instruction from the summary information. For example, the type of plan indicated by the corresponding historical instructions is the same as the type of the first plan. The filtered target summary information can improve the matching degree with the user's needs for making plans this time, and can also effectively reduce the amount of data that needs to be processed later.

[0129] Step S803: Update the first user information according to the target summary information.

[0130] If the target summary information has no conflict with the first user information, the target summary information may be added to the first user information.

[0131] If the target summary information conflicts with the first user information, the first user information may be used as the basis and the conflicting target summary information may be deleted, or a conflict prompt may be displayed to prompt the user to confirm the user information to be used, and the user information confirmed by the user may be updated to the first user information.

[0132] The display device 200 can use the large model to perform steps S801-S803. Figure 6 The large model can call the memory module supported by the assistant framework, for example, send a request for obtaining summary information to the memory module through a corresponding interface, and the request may include relevant information such as the instruction content of the first instruction, and the relevant information is used to filter the summary information. The memory module filters the target summary information in response to the request and feeds the target summary information back to the large model.

[0133] Therefore, the updated first user information can more accurately reflect the user's preferences, habits, needs, etc., and can further improve the accuracy of the target task set subsequently obtained based on the updated first user information.

[0134] In some embodiments, the display device 200 can use the large model to plan each task for realizing the user's intention according to each first requirement and the first user information. It can be seen that the workload of planning tasks is large and the time required is also long.

[0135] In other embodiments, the display device 200 may utilize the historical task set to assist in planning tasks for achieving the user's intentions, so as to reduce the workload of planning tasks and shorten the time required for planning tasks.

[0136] The historical task set corresponds to the historical instructions instructing the user to formulate the corresponding plan. That is to say, the tasks contained in each historical task set are used to realize the user intention indicated by the historical instructions corresponding to the corresponding historical task set, that is, to formulate the plan instructed by the corresponding historical instructions.

[0137] In some embodiments, the display device 200 may be configured to store a historical task set corresponding to each historical instruction.

[0138] In some embodiments, the display device 200 may be configured to process the historical task set corresponding to each historical instruction and store the processed historical task set.

[0139] In one example, the display device 200 filters out successful tasks from the tasks included in the historical task set. For example, a reflection assistant (also called a reflection agent) can be constructed, and the reflection assistant filters out successful tasks based on the historical instructions corresponding to the historical task set, the trajectory of executing each task, the execution results of each task, and the feedback on success or failure given by the user.

[0140] The display device 200 may group and cluster the successful tasks according to the historical instructions, and filter out high-quality successful tasks including subtasks less than or equal to a specified number from each group of successful tasks.

[0141] The display device 200 can generate corresponding prompt information for high-quality successful tasks in the historical task set. The prompt information may include corresponding content in the instruction content of the historical instructions, the thinking process of the reflection assistant, information about the tools called to execute the task, etc.

[0142] Successful tasks other than high-quality successful tasks in the historical task set are non-high-quality successful tasks. The display device 200 can generate corresponding prompt information for non-high-quality successful tasks. The prompt information may include corresponding content in the instruction content of historical instructions, the thinking process of the reflection assistant, information about the tool called to execute the task, the calling result returned by the called tool, rules for removing invalid / erroneous subtasks, etc.

[0143] Tasks other than successful tasks in the historical task set are failed tasks. The display device 200 can generate corresponding prompt information for non-high-quality successful tasks and failed tasks. The prompt information is negative prompt information. The negative prompt information may include corresponding content in the instruction content of historical instructions, the thinking process of the reflection assistant, information about the tool called to execute the task, the calling result returned by the called tool, subtasks that have no positive effect on the instruction content, etc.

[0144] In some embodiments, in combination Figure 5 ,The assistant framework can also support task modules, which can also be called task decision building and task retrieval modules. ,The task module can perform the processing and storage tasks of the ,historical task set.

[0145] Step S402: Obtain at least one historical task set.

[0146] The display device 200 may obtain at least one stored historical task set.

[0147] Step S403: Filter out a first historical task set matching the first instruction from at least one historical task set.

[0148] Fig. 9 The flowchart of the display device 200 screening the first historical task set in the embodiment of the present application, the specific steps are as follows:

[0149] Step S901: Obtain historical instructions corresponding to each historical task set in at least one historical task set.

[0150] The historical instructions may include corresponding text data, and the historical instructions may also include corresponding user intentions, summary information, etc.

[0151] Step S902: Match the first instruction with each historical instruction, and / or match the first instruction with each task in each historical task set to obtain a matching result.

[0152] The matching result between the first instruction and the historical instruction may represent the matching degree between the user intention corresponding to the first instruction and the historical instruction, the semantic matching degree between the text data corresponding to the first instruction and the historical instruction, or the information matching degree between the summary information corresponding to the first instruction and the historical instruction, etc.

[0153] The matching result between the first instruction and the task in the historical task set may indicate the matching degree between the first requirement corresponding to the first instruction and the requirement satisfied by the task in the historical task set.

[0154] Step S903: Filter out a first historical task set from at least one historical task set according to the matching result.

[0155] If the first instruction matches the historical instruction, it means that the first instruction matches the user intention, corresponding text data, corresponding summary information, etc. corresponding to the historical instruction. The plan formulated based on the historical task set corresponding to the historical instruction has a higher probability of meeting the user's needs for formulating the first plan.

[0156] If the first requirement corresponding to the first instruction matches the requirement satisfied by the task in the historical task set, it means that the plan formulated based on the historical task set corresponding to the historical instruction can better meet the user's requirement for the first plan.

[0157] The matching result corresponding to the first historical task set screened by the display device 200 can satisfy the first matching result and / or the second matching result. The first matching result is that the first instruction matches the historical instruction corresponding to the first historical task set, and the second matching result is that the task in the first historical task set matches at least one first requirement corresponding to the first instruction.

[0158] Among them, the first historical task set includes prompt information corresponding to various tasks, which is used to optimize the subsequent adjustment of the first historical task set.

[0159] In some embodiments, Figure 5 The task module shown performs the task of filtering the first historical task set.

[0160] Combination Figure 6 The big model can call the task module supported by the assistant framework. For example, it can send a request to the task module through the corresponding interface to obtain the historical task set. The request can include relevant information such as the instruction content of the first instruction, and the relevant information is used to match the historical task set. The task module selects the first historical task set in response to the request and feeds the first historical task set back to the big model.

[0161] Step S404: According to the user intention, the first user information and the at least one first requirement, the tasks in the first historical task set are adjusted to obtain a target task set.

[0162] The display device 200 adjusts the tasks therein based on the first historical task set according to user intention, first user information and at least one first requirement, and can quickly and accurately obtain a target task set that meets the user intention, user information and user requirements of the first plan formulated this time.

[0163] Fig.10 This is a flowchart of the display device 200 adjusting the first historical task set in an embodiment of the present application, and the specific steps are as follows:

[0164] Step S1001: Filter out a first task from tasks included in a first historical task set.

[0165] The first task is a task that needs to be adjusted, for example, needs to be deleted, parameters need to be adjusted, etc. The first task does not match at least one of the user intention, the first user information, and the at least one first requirement.

[0166] Step S1002: Filter out requirements to be planned from at least one first requirement.

[0167] The requirements to be planned do not match any of the tasks in the first historical task set, that is, any of the tasks in the first historical task set cannot meet / achieve the requirements to be planned.

[0168] Step S1003: According to the user intention, the first user information and the mismatched information in the at least one first requirement, the first task is adjusted, and the second task corresponding to the requirement to be planned is added to the first historical task set to obtain a target task set.

[0169] The first task is adjusted so that the adjusted first task can match the originally mismatched information. For example, if the first task before the adjustment does not match the first user information, the adjusted first task will match the first user information.

[0170] A second task corresponding to the requirement to be planned is added to the first historical task set, and the requirement to be planned is satisfied / realized by the second task.

[0171] Thus, the target task set can accurately match the user intention, the first user information and each first required task.

[0172] In some embodiments, the large model can be configured to have a function of calling a tool, and the tool is used to perform the task planned by the large model. Figure 5 The assistant framework may also support a tool library, which may include at least one tool set, and different tool sets may correspond to different scenarios. For example, the same tool set may correspond to different scenarios, and different tool sets may correspond to the same scenario. Each tool set may include at least one tool.

[0173] Fig.11 A schematic diagram of the structure of a tool library provided in an embodiment of the present application, wherein the tool sets included in the tool library may correspond to scenes such as movie watching scenes, education scenes, game scenes, and fitness scenes. Among them, the tool sets corresponding to the movie watching scenes may include drama chasing tools, and the tool sets corresponding to the fitness scenes may include fitness recommendation tools. The fitness recommendation tools may include weather query tools, fitness video query tools, fitness venue query tools, food management tools, recipe query tools, scenic spot query tools, memo tools, and the like.

[0174] When adjusting the first historical task set, the display device 200 may also plan tasks according to the tool library.

[0175] Fig.12 This is a flowchart of the display device 200 planning tasks according to the tool library in the embodiment of the present application, and the specific steps are as follows:

[0176] Step S1201: Obtain tool information of available tools.

[0177] In some embodiments, the scene corresponding to the toolset has a corresponding relationship with the user's intention, wherein the user's intention may correspond to at least one scene. For example, fitness intention may correspond to a fitness scene; and entertainment intention may correspond to a movie-watching scene and a game scene.

[0178] Based on the correspondence between the user intent and the scenario, the display device 200 can determine the scenario corresponding to the user intent this time, and determine the tool set corresponding to the scenario, and the tools included in the tool set are the available tools for this planning. The tool information of the available tools may include description information of the interface, such as the interface name, interface details, input parameters and output parameters of the interface, etc.

[0179] Step S1202: adding a third task to the first historical task set according to the tool information of the available tools, where the third task has a corresponding available tool.

[0180] Tools and tasks have a corresponding relationship, that is, tools are used to perform corresponding tasks. Based on the corresponding relationship between tools and tasks, the third task corresponding to the available tools can be determined, that is, the task corresponding to the current user intention, that is, the task required to achieve the current user intention.

[0181] Combination Figure 6 The big model can call the tool library, for example, send a request to the tool library to obtain available tools, and the request may include the user's intention. The tool library responds to the request, filters out available tools that match the user's intention, and feeds back the tool information of the available tools to the big model, and the big model adds the third task according to the tool information of the available tools.

[0182] In this way, when planning the task this time, planning can be carried out based on the tools available in these tools to ensure planning efficiency, improve the richness of the planned tasks, and ensure the executability of the planned tasks.

[0183] In some embodiments, the display device 200 may pre-establish a correspondence between user intention and associated tasks, and the associated tasks of the user intention may be obtained by iterative learning based on historical instructions using a large model. According to the associated tasks of the user intention, the tasks required this time may be quickly planned.

[0184] Fig.13 This is a flowchart of the display device 200 planning tasks according to the associated tasks in the embodiment of the present application, and the specific steps are as follows:

[0185] Step S1301: Obtain the associated tasks of the user's intention.

[0186] The display device 200 may obtain the associated tasks corresponding to the current user intention, and the associated tasks may be used to enrich the currently planned tasks.

[0187] Step S1302: Acquire a fourth task in the associated tasks that is different from the tasks in the first historical task set.

[0188] A fourth task that is different from any task in the first historical task set is selected from the associated tasks to avoid duplication of the added associated tasks with tasks in the first historical task set.

[0189] Step S1303: Add the fourth task to the first historical task set to obtain a target task set.

[0190] By adding the fourth task to the first historical task set, the target task set can be obtained.

[0191] The display device 200 can automatically expand the content that the user may need and formulate a first plan with richer content by directly adding the associated tasks intended by the user to the first historical task set.

[0192] Combination Figure 6 ,The big model adjusts the first historical task set based on various ,input information, such as user intention, first user information, first requirement, first historical ,task set (including various prompt information), tool information of available tools, etc., and obtains the target task set.

[0193] Step S405: calling the target tool corresponding to each task in the target task set, and executing the corresponding task through the target tool to obtain a first plan.

[0194] The display device 200 determines the target tool corresponding to each task in the target task set, and executes the corresponding task by calling each target tool, and each execution result constitutes a first plan.

[0195] Fig.14 This is a flowchart of the display device 200 performing tasks in an embodiment of the present application, and the specific steps are as follows:

[0196] Step S1401: Acquire the first category of tasks and the second category of tasks in the target task set.

[0197] The first type of tasks correspond to the unadjusted tasks in the first historical task set, that is, the first type of tasks are original tasks in the first historical task set and are tasks that have been executed. Therefore, the first type of tasks have corresponding execution results.

[0198] The second category of tasks refers to the tasks in the target task set other than the first category of tasks, that is, the second category of tasks are not original tasks in the first historical task set and cannot be regarded as tasks that have been executed. Therefore, the second category of tasks do not have corresponding execution results.

[0199] Step S1402: If the first historical task set includes execution results corresponding to each task, the execution results corresponding to the first type of tasks are obtained from the first historical task set.

[0200] The execution results corresponding to the first type of tasks can be directly obtained from the first historical task set, so there is no need to re-execute the first type of tasks, thus saving the time required to execute the first type of tasks.

[0201] Step S1403: calling the target tool corresponding to the second type of task, and executing the corresponding second type of task through the target tool to obtain the execution result of the second type of task.

[0202] Combination Figure 6 ,The large model calls the target tool corresponding to the second type of tasks, and the target tool feeds back the execution result to the large model after executing the second type of tasks.

[0203] Step S1404: The execution results corresponding to the first type of tasks and the execution results of the second type of tasks form a first plan.

[0204] When executing tasks in the target task set, the display device 200 can directly use the execution results of the first type of tasks and only needs to execute the second type of tasks, thereby effectively reducing the number of tasks that actually need to be executed and improving the overall efficiency of executing tasks.

[0205] Step S406: Display the first plan.

[0206] Combination Figure 6 , the big model returns the first plan to the assistant application, and the assistant application displays the first plan.

[0207] In some embodiments, the way in which the display device 200 displays the first plan may include displaying the first plan in an assistant interaction interface, playing the first plan through voice, etc.

[0208] The process of the display device 200 making the first plan for the user in the form of voice interaction is described with reference to the following examples.

[0209] Fig.15 FIG. 2 is an interactive diagram of the display device 200 for formulating a fitness plan for a user in an embodiment of the present application. Fig.15 As shown in ①, after entering the fitness application, the display device 200 can display the assistant interaction interface in response to the wake-up word spoken by the user, and the assistant interaction interface can show the interaction between the fitness assistant and the user in the form of a dialogue. For example, the fitness assistant first asks the user "Please tell me your fitness needs."

[0210] The user can say the first command, such as "I want to exercise, I like outdoor sports, such as mountain climbing, running, swimming, etc. Please help me make a fitness plan. I usually have time on weekends, but I work overtime on weekdays and get home around 9 o'clock." Fig.15 As shown in ②, the display device 200 can convert the first instruction into text data and display it in the assistant interaction interface. At the same time, the display device 200 will formulate a first plan according to the first instruction.

[0211] The display device 200 can use the big model to identify the user's intention as a fitness intention, and extract the first requirement including liking the outdoors, hiking, running, swimming, etc., and the time is scheduled after 9 pm on weekdays and weekends. The big model can obtain the first user information based on the voice features of the first instruction, and additionally obtain the positioning information, call the memory module to obtain the target summary information, etc. The big model can call the task module to obtain the first historical task set, and call the tool library to obtain the tool information of the available tools. The big model combines the above information to adjust the first historical task set to obtain the target task set, which may include querying the weather, querying attractions, querying swimming pools, querying ingredients, querying recipes, and setting memos. The big model obtains the execution results of each task by calling the target tools corresponding to each task in the target task set, and summarizes them into a first plan. The first plan can be "You can go swimming in swimming pool A on weekdays; you can go hiking in mountain B and run outdoors at attraction C on weekends; design recipe D according to the ingredients in your refrigerator; a fitness memo has been set for you.". For example Fig.15 As shown in ③, the display device 200 displays the first plan on the assistant interaction interface and can perform voice broadcast.

[0212] In some embodiments, a plan formulation method is also provided, which can be applied to the display device 200 provided in the embodiment of the present application. The method includes: in response to a first instruction of a user indicating to formulate a first plan, according to the instruction content of the first instruction, obtaining the user's intention, the first user information and at least one first requirement of the user for the first plan; obtaining at least one historical task set, the historical task set corresponding to the historical instruction of the user indicating to formulate a corresponding plan; screening out the first historical task set matching the first instruction from at least one historical task set; adjusting the tasks in the first historical task set according to the user's intention, the first user information and the at least one first requirement to obtain a target task set; calling the target tool corresponding to each task in the target task set, and executing the corresponding task through the target tool to obtain the first plan; displaying the first plan.

[0213] The above technical solution has the following advantages or beneficial effects: the display device 200 responds to the first instruction of the user to formulate the first plan, and can analyze the instruction content of the first instruction to accurately obtain the user's intention, the first user information and the first requirement of the user for the first plan. The display device 200 can first filter out the first historical task set that matches the first instruction from the historical task set, and adjust the first historical task set according to the user's intention, the first user information and the first requirement to quickly obtain the target task set that can match the first plan, thereby reducing the workload and time consumption of planning tasks, improving the efficiency of obtaining the target task set, and further improving the efficiency of formulating the first plan.

[0214] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are intended to better explain the content of this disclosure, so that those skilled in the art can better use the embodiments.

Claims

1. A display device, characterized in that: include: The controller is configured as: In response to a first instruction from a user to formulate a first plan, obtaining, according to the instruction content of the first instruction, a user intention, first user information, and at least one first requirement of the user for the first plan; Acquire at least one historical task set, where the historical task set corresponds to a historical instruction from a user to formulate a corresponding plan; Filtering a first historical task set matching the first instruction from the at least one historical task set; According to the user intention, the first user information and the at least one first requirement, adjusting the tasks in the first historical task set to obtain a target task set; Calling the target tool corresponding to each task in the target task set, and executing the corresponding task through the target tool to obtain the first plan; Show the first plan.

2. The display device according to claim 1, characterized in that The controller executes a first instruction for formulating a first plan in response to a user instruction, and acquires user intention, user information, and at least one first requirement of the user for the first plan according to the instruction content of the first instruction, and is specifically configured as follows: Acquiring the user intention according to the instruction content of the first instruction; According to the user intention, the first user information and the at least one first requirement are extracted from the first text.

3. The display device according to claim 1 or 2, characterized in that: The controller executes a first instruction for formulating a first plan in response to a user instruction, and acquires a user intention, first user information, and at least one first requirement of the user for the first plan according to the instruction content of the first instruction, and is specifically configured as follows: If the instruction content of the first instruction does not include the first user information, when the first instruction is a voice instruction, obtaining a voice feature corresponding to the first instruction; The first user information is acquired according to the voice feature.

4. The display device according to claim 3, characterized in that The controller executes a first instruction for formulating a first plan in response to a user instruction, obtains a user intention, first user information, and at least one first requirement of the user for the first plan according to the instruction content of the first instruction, and is further configured to: Obtain summary information corresponding to the historical instruction, where the summary information is used to characterize a specified dimension of the historical instruction; Filtering target summary information matching the instruction content of the first instruction from the summary information; The first user information is updated according to the target summary information.

5. The display device according to claim 1, characterized in that The controller performs filtering out a first historical task set matching the first instruction from the at least one historical task set, and is specifically configured as follows: Obtain the historical instruction corresponding to each of the historical task sets in the at least one historical task set; Matching the first instruction with each of the historical instructions, and / or matching the first instruction with each of the tasks in the historical task sets to obtain a matching result; According to the matching result, the first historical task set is filtered out from the at least one historical task set, wherein the matching result corresponding to the first historical task set satisfies the first matching result and / or the second matching result, the first matching result is that the first instruction matches the historical instruction corresponding to the first historical task set, and the second matching result is that the task in the first historical task set matches the at least one first requirement corresponding to the first instruction.

6. The display device according to claim 4, characterized in that The controller performs adjusting the tasks in the first historical task set according to the user intention, the first user information and the at least one first requirement to obtain the target task set, and is specifically configured as follows: Filtering out a first task from the tasks included in the first historical task set, wherein the first task does not match at least one of the user intention, the first user information, and the at least one first requirement; Filtering out a requirement to be planned from the at least one first requirement, wherein the requirement to be planned does not match any task in the first historical task set; According to the user intention, the first user information and the mismatched information in the at least one first requirement, the first task is adjusted, and a second task corresponding to the requirement to be planned is added to the first historical task set to obtain the target task set.

7. The display device according to claim 1, characterized in that The controller adjusts the tasks in the first historical task set according to the user intention, the first user information and the at least one first requirement to obtain a target task set, and is further configured to: Get tool information for available tools; A third task is added to the first historical task set according to the tool information of the available tool, and the third task has the corresponding available tool.

8. The display device according to claim 1, characterized in that The controller performs adjusting the tasks in the first historical task set according to the user intention, the first user information and the at least one first requirement to obtain the target task set, and is further configured to: Obtaining tasks associated with the user's intention; Acquire a fourth task in the associated tasks that is different from the tasks in the first historical task set; The fourth task is added to the first historical task set to obtain the target task set.

9. The display device according to claim 1, characterized in that: The controller executes calling the target tool corresponding to each task in the target task set, and executes the corresponding task through the target tool to obtain the first plan, which is specifically configured as follows: Acquire a first category of tasks and a second category of tasks in the target task set, wherein the first category of tasks are tasks that have not been adjusted in the first historical task set, and the second category of tasks are tasks in the target task set other than the first category of tasks; If the first historical task set includes execution results corresponding to each task, obtaining execution results corresponding to the first type of tasks from the first historical task set; Calling the target tool corresponding to the second-type task, and executing the corresponding second-type task through the target tool to obtain the execution result of the second-type task; The first plan is composed of the execution results corresponding to the first type of tasks and the execution results of the second type of tasks.

10. A method for formulating a plan, characterized in that: Applied to a display device, the method comprises: In response to a first instruction from a user to formulate a first plan, obtaining, according to the instruction content of the first instruction, a user intention, first user information, and at least one first requirement of the user for the first plan; Acquire at least one historical task set, where the historical task set corresponds to a historical instruction from a user to formulate a corresponding plan; Filtering a first historical task set matching the first instruction from the at least one historical task set; According to the user intention, the first user information and the at least one first requirement, adjusting the tasks in the first historical task set to obtain a target task set; Calling the target tool corresponding to each task in the target task set, and executing the corresponding task through the target tool to obtain the first plan; Show the first plan.

Images