Page display method and electronic equipment

Abstract

The invention provides a page display method and electronic equipment, relates to the technical field of terminals, and can omit a process of displaying an intermediate jump page, realize non-inductive operation of a user when a task is automatically executed, reduce visual interference of the user and improve user experience. In the method, the electronic equipment displays a first page, then responds to a first task instruction of a user, the electronic equipment obtains a first task path corresponding to the first page, and finally, after a first task is executed, the electronic equipment displays a second page where the last control on the first execution path is located. Wherein the first task path is used for indicating execution of a first task corresponding to the first task instruction; the first task path comprises at least two controls which have a dependency relationship and are related to the first task; after the functions or tasks corresponding to the at least two controls are executed in sequence, the first task is executed.

Description

Technical Field

[0001] This application relates to the field of terminal technology, and in particular to a page display method and an electronic device. Background Technology

[0002] With the development of artificial intelligence, task automation has become a goal pursued in the terminal field. Achieving task automation through voice assistants is the mainstream trend today. Voice assistants can assist users in executing simple, basic voice commands, such as setting alarms and playing music.

[0003] Currently, after receiving a user command, the intelligent voice assistant takes a screenshot, inputs the screenshot and the user command into a large language model to determine and execute the task corresponding to the user command. When the large language model determines the next page to jump to in order to execute the task, it executes the logic code to jump to that page so that the intelligent voice assistant can display the page. The intelligent voice assistant then takes a new screenshot and inputs it into the large language model for the next round of interaction. The intelligent voice assistant needs to display the page that is jumped to each time during the execution of the task, which affects the user experience. Summary of the Invention

[0004] This application provides a page display method and electronic device that can obtain a task path and display the page containing the last control on the task path after the task corresponding to the task path has been executed. This reduces the process of displaying and jumping to a new page and improves the user's seamless experience of task execution.

[0005] To achieve the above objectives, the embodiments of this application adopt the following technical solutions:

[0006] Firstly, a page display method is provided, in which a first page is displayed, then, in response to the user's first task instruction, the first task path corresponding to the first page is obtained, and finally, after the first task is completed, the second page containing the last control on the first execution path is displayed.

[0007] The first task path is used to indicate the first task corresponding to the execution of the first task instruction; the first task path includes at least two controls that have a dependency relationship and are related to the first task; after the functions or tasks corresponding to the at least two controls are executed in sequence, the first task is completed.

[0008] For example, the first page and the second page may belong to the same application or different applications, in order to meet the execution of different tasks.

[0009] In the above page display method, by obtaining the first task path corresponding to the first page, and after executing the first task corresponding to the first task path, the page containing the last control of the first task path is displayed. This reduces the process of displaying intermediate page jumps, realizes the user's seamless experience of automatic task execution, and improves the user experience.

[0010] In one possible implementation of the first aspect, the first page includes at least one control; a first control related to the first task is obtained from the at least one control on the first page; then, at least one task path with the first control as the first control is obtained; finally, the first task path with the fewest controls is obtained from the at least one task path; wherein each task path in the at least one task path represents a way of executing the first task. It is evident that the first task can have multiple task paths, and obtaining the task path with the fewest controls can improve the execution speed of the first task.

[0011] In one possible implementation of the first aspect, during the execution of the first task, a third page containing the control to be verified on the first task path is displayed; wherein the control to be verified is used to indicate the execution progress of the first task or to verify any one of password, verification code, gesture, identity, or answer to a security question. It is evident that displaying the control to be verified to the user during task execution can also improve the security of task execution.

[0012] In one possible implementation of the first aspect, when the control to be verified is used to verify a password, the password entered by the user in the control to be verified on the third page is received. Then, after the password is successfully verified, the first task continues to be executed. Finally, after the first task is completed, the second page containing the last control on the first execution path is displayed. It is evident that by displaying the page containing the control to be verified, interacting with the user, and verifying the user-entered password, the first task can only continue to be executed after successful verification, thereby improving the security of task execution and reducing user risk.

[0013] In one possible implementation of the first aspect, the aforementioned page display method is applied to an electronic device, which includes a virtual screen. The virtual screen handles the pages corresponding to each control on the first task path during the execution of the first task. On the page handled by the virtual screen, user actions are simulated to trigger controls in the first task path, causing the virtual screen to handle the page corresponding to the next control in the first task path. When the page handled by the virtual screen is the page corresponding to the last control on the first task path, the first task is completed. Therefore, by executing the first task through the virtual screen on the electronic device, there is no need to display the jump pages during the execution of the first task to the user, achieving seamless user operation and improving the user experience.

[0014] In one possible implementation of the first aspect, page information of a first page is obtained. Then, based on the page information, the corresponding redirection logic for the first page is obtained. Based on the first task instruction and the redirection logic, at least one task path for the first control as the primary control is obtained. The page information includes the attributes and state of each control in at least one control on the first page. The redirection logic indicates at least one page involved in completing the first task, the controls on each page, and the dependencies between each control. It is evident that by obtaining the corresponding redirection logic through page information and obtaining at least one task path for the first control based on the redirection logic, there is no need to display the redirection page each time or take screenshots after each page redirection. Multiple interactions with the server can directly determine the task path locally, reducing the number of interactions with the server and improving task execution speed.

[0015] In one possible implementation of the first aspect, when the first task is to enable the first function, the last control displayed on the second page along the first execution path is the control corresponding to the first function in the enabled state; when the first task is to disable the first function, the last control displayed on the second page along the first execution path is the control corresponding to the first function in the disabled state. It is evident that the corresponding first task can be executed by changing the state of the control, enabling the task to execute automatically and only displaying the final page after the task is completed, thus improving the user experience.

[0016] In one possible implementation of the first aspect, a first task instruction and the corresponding redirection logic of the first page are sent to the server. Then, the last control used to complete the execution of the first task is received from the server. Finally, based on the last control, at least one task path is obtained for the first control as the first control. The last control used to complete the execution of the first task is obtained by the server based on the first task instruction and the redirection logic of the first page. It can be seen that the last control used to complete the execution of the first task can also be obtained from the server, and the task path can be obtained locally, providing multiple scenarios for obtaining the task path and improving the applicability of task execution.

[0017] In a second aspect, an electronic device is provided, the electronic device including a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, and when the computer instructions are executed by the processor, the electronic device performs a page display method as described in the first aspect and any implementation thereof.

[0018] Thirdly, a computer-readable storage medium is provided, including computer instructions that, when executed on an electronic device, cause the electronic device to perform a page display method as described in the first aspect and any implementation thereof.

[0019] Fourthly, a computer program product is provided that, when run on an electronic device, causes the electronic device to execute the page display method as described in the first aspect and any of its implementations.

[0020] The beneficial effects that the electronic device provided in the second aspect, the computer-readable storage medium provided in the third aspect, and the computer program product provided in the fourth aspect can achieve are similar to the beneficial effects that can be achieved in the first aspect and any of its implementations, and will not be repeated here. Attached Figure Description

[0021] Figure 1 This illustration shows a schematic diagram of task execution in the prior art according to an embodiment of this application;

[0022] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application is shown;

[0023] Figure 3 A schematic diagram of the software structure of an electronic device provided in an embodiment of this application is shown;

[0024] Figure 4 A schematic diagram of the software structure of another electronic device provided in an embodiment of this application is shown;

[0025] Figure 5 A flowchart of a page display method provided in an embodiment of this application is shown;

[0026] Figure 6 This illustration shows a schematic diagram of a page display provided in an embodiment of this application;

[0027] Figure 7 This document illustrates a flowchart of a logic jump method provided in an embodiment of this application.

[0028] Figure 8 This illustration shows a schematic diagram of page path information provided in an embodiment of this application;

[0029] Figure 9 A schematic diagram of a jump logic provided in an embodiment of this application is shown;

[0030] Figure 10 A schematic diagram of a prompt word provided in an embodiment of this application is shown;

[0031] Figure 11 This illustration shows one of the flowcharts for task execution provided in an embodiment of this application;

[0032] Figure 12 This illustrates a second flowchart of a task execution method provided in an embodiment of this application.

[0033] Figure 13 A schematic diagram of a task path provided in an embodiment of this application is shown;

[0034] Figure 14 This illustrates a third flowchart of a task execution method provided in an embodiment of this application.

[0035] Figure 15 This document illustrates a fourth flowchart of a task execution method provided in an embodiment of this application.

[0036] Figure 16 This illustration shows a schematic diagram of a task execution comparison provided in an embodiment of this application;

[0037] Figure 17 This document illustrates a fifth flowchart of a task execution method provided in an embodiment of this application.

[0038] Figure 18 A schematic diagram of the hardware structure of another electronic device provided in an embodiment of this application is shown. Detailed Implementation

[0039] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of this application, unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can represent A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone, where A and B can be singular or plural. Furthermore, in the description of this application, unless otherwise stated, "multiple" refers to two or more. "At least one of the following" or similar expressions refer to any combination of these items, including any combination of single or plural items. For example, at least one of a, b, or c can represent: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or multiple. Furthermore, to facilitate a clear description of the technical solutions in the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish identical or similar items with substantially the same function and effect. Those skilled in the art will understand that the terms "first" and "second" do not limit the quantity or execution order, and that "first" and "second" are not necessarily different. Meanwhile, in the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is being used as an example, illustration, or description. Any embodiment or design scheme described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design schemes. Specifically, the use of terms such as "exemplary" or "for example" is intended to present related concepts in a concrete manner for ease of understanding.

[0040] Furthermore, the business scenarios described in the embodiments of this application are for the purpose of more clearly illustrating the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. As those skilled in the art will know, with the emergence of new business scenarios, the technical solutions provided by the embodiments of this application are also applicable to similar technical problems.

[0041] In the mobile terminal field, the automatic completion of various terminal tasks based on voice assistants has become the mainstream trend. For example, Xiaoyi Assistant can assist users in executing simple basic voice commands. For instance, if a user issues the command "Xiaoyi, set an alarm for 6 PM today," Xiaoyi Assistant will execute the task of setting an alarm for 6 PM today. However, traditional voice assistants have low accuracy in recognizing human-computer intent and cannot recognize complex command sets, resulting in a poor human-computer interaction experience.

[0042] In recent years, the emergence of large language models, represented by the Transformer neural network architecture, has attracted widespread attention in the industry. Among them, the chatbot model (Chat Generative Pre-trained Transformer, ChatGPT) has garnered the most attention, possessing powerful reasoning capabilities and high accuracy in recognizing human-computer intent in complex scenarios. Furthermore, large language models support multimodal natural interaction, including text, voice, and images, and are considered by the industry to be a perfect replacement for traditional voice assistants in the terminal field.

[0043] Currently, terminal task automation based on large language models has become a research hotspot and challenge in the industry. How to enable large language models to accurately understand user commands and automatically complete terminal tasks at a low cost is a problem that urgently needs to be solved. Furthermore, the large number of parameters in large language models makes them difficult to deploy perfectly on mobile terminals. Therefore, using cloud-based large language models for terminal task automation has become an industry consensus, and its general framework includes... Figure 1 As shown, the large language model, acting as the neural hub of the task automation system, inputs screenshots from the terminal as prompts. The large language model then interacts with the terminal, identifies user intent, locates target options, and executes actions to navigate to the next page. The terminal needs to take another screenshot, which is then used as the prompt again to input into the large language model, allowing for the next round of interaction. It is evident that during task execution, the terminal needs to take a screenshot and interact with the large language model for each page transition. This high frequency of calls to the large language model impacts interaction latency, leading to longer task execution times. Furthermore, the large number of semantic unit tokens in the screenshots affects the inference speed of the large language model, and the page transitions displayed on the terminal increase the probability of distracting the user's view, failing to adequately meet the real-time requirements of human-computer interaction.

[0044] In view of this, this application provides a page display method. Taking its application in an electronic device as an example, the electronic device receives a user instruction, then obtains the path of the task corresponding to the user instruction, executes the path, and finally, after the path is executed, displays the page containing the last control on that path. It is evident that when the electronic device executes a task, it reduces the number of times the page is displayed during each page jump, reduces the interference with the user's vision during page jumps, and improves the user's seamless operation experience.

[0045] In some embodiments, firstly, the electronic device displays a first page; then, in response to a user's first task instruction, the electronic device obtains a first task path corresponding to the first page; finally, after the first task is completed, the electronic device displays a second page containing the last control on the first execution path.

[0046] The first task path is used to indicate the first task corresponding to the execution of the first task instruction. The first task path includes at least two controls that have a dependency relationship and are related to the first task. After the functions or tasks corresponding to the at least two controls are executed in sequence, the first task is completed.

[0047] For example, the first page and the second page may belong to the same application or different applications.

[0048] In the above method, the electronic device executes the first task corresponding to the first task path. After the first task is completed, the page containing the last control on the first task path is displayed, which reduces the number of page jumps and thus reduces the interference to the user's line of sight during page jumps. It can also further reduce the task execution time and improve the user experience.

[0049] The page display method provided in this application embodiment can be applied to electronic devices.

[0050] In some embodiments, such as Figure 2 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc.

[0051] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device 100. In other embodiments of this application, the electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0052] Processor 110 may include one or more processing units ( Figure 2(Not shown in the image), for example, processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0053] The controller can be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction opcode and timing signals to complete the control of fetching and executing instructions.

[0054] In some possible implementations, the processor 110 can specifically control the electronic device 100 to respond to the user's first task instruction, obtain the first task path corresponding to the first page, and display the second page where the last control on the first execution path is located after the first task corresponding to the first task path is completed.

[0055] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0056] In some embodiments, processor 110 may include one or more interfaces ( Figure 2 (Not shown in the image). For example, USB interface 130 is an interface conforming to the USB standard specification, specifically a Mini USB interface, Micro USB interface, USB Type-C interface, etc. USB interface 130 can be used to connect a charger to charge electronic device 100, and can also be used for data transfer between electronic device 100 and peripheral devices. It can also be used to connect headphones for audio playback. This interface can also be used to connect other electronic devices, such as AR devices.

[0057] The charging management module 140 is used to receive charging input from the charger. The charger can be a wireless charger or a wired charger.

[0058] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to power the processor 110, internal memory 121, external memory, display 194, camera 193, and wireless communication module 160, etc.

[0059] The wireless communication function of electronic device 100 can be realized through antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, modem processor and baseband processor, etc.

[0060] Antennas 1 and 2 are used to transmit and receive electromagnetic wave signals. The mobile communication module 150 can provide wireless communication solutions, including 2G / 3G / 4G / 5G, for use on the electronic device 100. The mobile communication module 150 can receive electromagnetic waves via antenna 1, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via antenna 1.

[0061] The wireless communication module 160 can provide solutions for wireless communication applications on the electronic device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies. The wireless communication module 160 receives electromagnetic waves via antenna 2, modulates and filters the electromagnetic wave signals, and sends the processed signal to processor 110. The wireless communication module 160 can also receive signals to be transmitted from processor 110, modulate and amplify them, and then convert them into electromagnetic waves for radiation via antenna 2.

[0062] In some embodiments, antenna 1 of electronic device 100 is coupled to mobile communication module 150, and antenna 2 is coupled to wireless communication module 160, so that electronic device 100 can communicate with networks and other devices through wireless communication technology.

[0063] Electronic device 100 implements display functions through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU performs mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information. Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel.

[0064] In some possible implementations, the electronic device 100 may display a first page or a second page via a display screen 194.

[0065] It is understood that the display screen 194 mentioned herein can serve as the screen in the following embodiments.

[0066] Electronic device 100 can perform shooting functions through ISP, camera 193, video codec, GPU, display 194 and application processor.

[0067] The ISP is used to process the data fed back by camera 193. Camera 193 is used to capture still images or videos.

[0068] A digital signal processor (DSP) is used to process digital signals, including digital image signals and other digital signals. A video codec is used to compress or decompress digital video. An NPU (Neural Processing Unit) is a neural network (NN) computing processor that, by borrowing the structure of biological neural networks, such as the transmission patterns between neurons in the human brain, rapidly processes input information and can continuously learn. NPUs enable intelligent cognitive applications in electronic devices, such as image recognition, facial recognition, speech recognition, and text understanding.

[0069] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to perform data storage functions.

[0070] Internal memory 121 can be used to store computer executable program code, which includes instructions. Processor 110 executes various functional applications and data processing of electronic device 100 by running the instructions stored in internal memory 121. Internal memory 121 may include a program storage area and a data storage area. The program storage area may store the operating system, at least one application program required for a function (such as sound playback, image playback, etc.), etc. The data storage area may store data created during the use of electronic device 100 (such as audio data, phonebook, etc.). Furthermore, internal memory 121 may include high-speed random access memory and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0071] Electronic device 100 can implement audio functions through audio module 170 and application processor, such as music playback and recording. Audio module 170 is used to convert digital audio information into analog audio signals for output, and also to convert analog audio input into digital audio signals. Audio module 170 can also be used for encoding and decoding audio signals.

[0072] Buttons 190 include a power button, volume buttons, etc. Buttons 190 can be mechanical buttons or touch-sensitive buttons. Motor 191 can generate vibration alerts. Motor 191 can be used for incoming call vibration alerts or for touch vibration feedback. Indicator 192 can be an indicator light, used to indicate charging status, battery level changes, or to indicate messages, missed calls, notifications, etc. SIM card interface 195 is used to connect a SIM card.

[0073] based on Figure 2 The electronic device shown implements the page display method in this application embodiment. It can obtain the task path of the task to be executed corresponding to the currently displayed page of the electronic device. After the task is completed, it displays the page where the last control in the task path is located, reducing the display process of page jump. This not only further improves the speed of task execution, but also reduces the visual interference of the user and improves the user experience.

[0074] The software system of electronic device 100 can adopt a layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture. This application embodiment uses a layered mobile operating system as an example to exemplify the software structure of electronic device 100.

[0075] like Figure 3As shown, the layered architecture divides the software into several layers, each with a clear role and function. Layers communicate with each other through software interfaces. In some embodiments, the mobile operating system is divided into four layers, from top to bottom: the application layer, the application framework layer, the system service layer, and the kernel layer.

[0076] The application layer can include a series of application packages.

[0077] like Figure 3 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and SMS.

[0078] The application framework layer provides application programming interfaces (APIs) and a programming framework for applications in the application layer. The application framework layer includes some predefined functions.

[0079] like Figure 3 As shown, the application framework layer may include a window manager, content provider, view system, phone manager, resource manager, notification manager, etc.

[0080] The view system includes visual controls, such as controls for displaying text and controls for displaying images. The view system can be used to build applications. The display interface can consist of one or more views.

[0081] The system service layer can include multiple functional modules. For example: surface manager, media libraries, 3D graphics processing libraries (e.g., OpenGL ES), 2D graphics engines (e.g., SGL), etc.

[0082] In some embodiments, the system service layer of the electronic device 100 may further include a task execution module. The task execution module is used to display a first page on the electronic device, respond to a first task instruction from the user, obtain a first task path corresponding to the first page, and display a second page where the last control on the first execution path is located after the first task corresponding to the first task instruction is executed.

[0083] The kernel layer is the layer between hardware and software. The kernel layer contains at least the display driver, camera driver, audio driver, and sensor driver.

[0084] based on Figure 3 The electronic device shown implements the page display method in the embodiments of this application, which can reduce the process of page jump, reduce task execution time, reduce visual interference to users, and improve user experience.

[0085] In some embodiments, the structure of the electronic device 100 may also be as follows: Figure 4 As shown, the electronic device 100 includes an interaction module, a processing module, and an inference module. The interaction module can be integrated into applications such as intelligent voice assistants like Xiaoyi. The interaction module interacts with the user, obtains the user's input of a first task instruction and the corresponding jump logic for the first page, and sends the first task instruction and the jump logic for the first page to the inference module after performing multimodal data processing. The first page is the page currently displayed on the screen of the electronic device. The jump logic indicates at least one page involved in completing the first task instruction, the controls on each page, and the dependencies between each control. Multimodal data processing includes noise removal and privacy encryption. The processing module can provide an application programming interface (API). The interface (API) is provided for applications like Xiaoyi to call. The processing module obtains the page information of the first page, retrieves the corresponding navigation logic based on the page information, manages the data of the navigation logic, and sends the navigation logic to the interaction module. The inference module can provide a large language model API. The inference module obtains the first task instruction and the corresponding navigation logic of the first page, understands the user intent, performs behavior inference, and performs tasks such as long short-term memory based on the first task instruction and the corresponding navigation logic, determines the last control to complete the first task, and sends the control to the interaction module. After receiving the control, the interaction module... The processing module is invoked, calling its corresponding API. The processing module also uses a local path optimization algorithm to obtain the first task path based on the control, and manipulates the virtual screen on the electronic device to execute the first task corresponding to the first task path. After the first task is completed, the page containing the control is displayed. The virtual screen is a virtual space where the user extends the desktop environment of the electronic device beyond the physical screen. It can be understood as a virtual area where the user can perform various operations, such as opening applications, moving windows, and clicking controls, which can then be "dragged" onto the physical screen when needed. This provides users with a wider workspace, making multitasking more efficient and convenient.

[0086] based on Figure 4 The electronic device shown implements the page display method in the embodiments of this application, which can reduce the process of page jump, further improve the speed of task execution, reduce visual interference to users, and improve the user's seamless operation experience.

[0087] The aforementioned electronic devices can be mobile phones, tablets, wearable devices (such as smartwatches, smart bracelets, etc.), smart home devices (such as televisions, etc.), in-vehicle systems (such as in-vehicle computers), etc. Among them, mobile phones can be foldable screen phones or non-foldable screen phones.

[0088] The following uses a mobile phone as an example to illustrate the page display method provided in the embodiments of this application.

[0089] See Figure 5 As shown, the above page display method may include the following steps S501-S503.

[0090] S501, the phone displays the first page.

[0091] For example, the first page can be the phone's desktop, the page of an application on the phone, the page of a mobile browser, or a desktop or page with a drop-down menu / pop-up / at least one window.

[0092] S502: The mobile phone responds to the user's first task command and obtains the first task path corresponding to the first page.

[0093] The first task path is used to indicate the first task corresponding to the execution of the first task instruction; the first task path includes at least two controls that have a dependency relationship and are related to the first task; after the functions or tasks corresponding to the at least two controls are executed in sequence, the first task is completed.

[0094] For example, the first task instruction can be a voice instruction, a text instruction, or a gesture instruction. For instance, a user can give a voice instruction to the phone to "set an alarm for 6 PM today," or a text instruction to the phone to "set an alarm for 6 PM today." If a "Z" shaped gesture is pre-set to correspond to a music playback task, the user can also make a "Z" shaped gesture on the phone screen to send the first task instruction to the phone.

[0095] For example, the first task corresponding to the first task instruction can be one or more. When the first task is multiple tasks, the multiple tasks can be related or unrelated. For example, the first task corresponding to the first task instruction can be a single task of setting an alarm, or it can be two unrelated tasks: setting an alarm and playing music. It can also be two related tasks: opening a meeting reminder and writing the meeting information from the meeting reminder into a memo.

[0096] For example, a control is a user-interactable element on a mobile screen to trigger a function, allowing the user to input, output, or interact. Controls can be functional controls or display controls that show text, images, or videos. Examples include buttons, input boxes, drop-down menus, checkboxes, radio buttons, labels, images, or videos. Figure 6 As shown, both "Wi-Fi" and "Bluetooth" are controls on the "Settings" page.

[0097] In some embodiments, before obtaining the first task path corresponding to the first page, the mobile phone first obtains the page information of the first page, then obtains the jump logic corresponding to the first page based on the page information of the first page, and finally obtains at least one task path of the first control as the first control based on the first task instruction and the jump logic.

[0098] For example, the first page includes at least one control. Before the phone obtains the first task path corresponding to the first page, the phone can obtain the first control related to the first task from at least one control on the first page. For example, the first task is to turn on Bluetooth, and the first page is... Figure 6 The first control on the "Settings" page shown is the "Bluetooth" control.

[0099] The page information includes the properties and state of each control in at least one control on the first page.

[0100] For example, attributes include the control's identification (ID), type, style, position, and layout. The type can be any of the following: button, input box, drop-down menu, checkbox, radio button, label, image, or video. The style includes color, font, and size. The state can be any of the following: on, off, selected, unselected, or value.

[0101] For example, such as Figure 7As shown, the mobile phone can extract page information through a deep neural network model or through an accessibility API. The page information can be in Extensible Markup Language (XML) format. The mobile phone can convert the XML into UI route map (URM) format using depth-first search (DFS) and merge algorithms. The mobile phone then uses DFS (e.g., recursion and backtracking algorithms) to generate complete navigation logic. This navigation logic can be in the form of a URM tree, a URM list, or a model. The navigation logic indicates at least one page involved in completing the first task, the controls on each page, and the dependencies between each control. For example, the first page is... Figure 6 The extracted XML format page information from the "Settings" page shown can be as follows:

[0102] <?xml version="1.0" encoding="UTF-8"> / / The version and encoding of the XML specification.

[0103] <hierarchy rotation=“0”> / / Hierarchical structure

[0104] <node…text=“WI-FI”…clickable=“true”…> / / Wireless LAN, properties can be clicked.

[0105] <node…text=“AB”…clickable=“true”…> / / The wireless LAN network name is "AB", and its properties can be viewed by clicking on it.

[0106] …

[0107] <node…text=“Bluetooth”…clickable=“true”…> / / Bluetooth, properties can be clicked.

[0108] <node…text=“Off”…clickable=“true”…> Bluetooth is off; properties can be accessed by clicking here.

[0109] …

[0110] / / End of this hierarchy

[0111] Through the aforementioned XML format page information, the mobile phone can obtain the "clickable" property and current status "AB" (the network name the phone is connected to) of the "Wi-Fi" control on the "Settings" page, as well as the "clickable" property and current status "off" of the "Bluetooth" control.

[0112] For example, a mobile phone can merge the information corresponding to controls belonging to the same attribute range in the page information, and convert the XML format into URM format using a depth-first traversal algorithm. For instance, the page information in the above XML format can be converted to obtain, as shown below. Figure 8 The page path information in URM format shown can be used by the mobile phone to traverse the hierarchical URM data using algorithms such as recursion and backtracking to generate the complete jump logic corresponding to the first page. The first page is the root node in the jump logic, such as... Figure 9 As shown, the root node is the "Settings" page, which includes "Wi-Fi" and "Bluetooth" controls. The child nodes of the "Settings" page (which depend on the child pages of the "Settings" page) include the corresponding pages for "Wi-Fi" and "Bluetooth". The "Wi-Fi" page includes a toggle control for "Wi-Fi" (which depends on the "Wi-Fi" control) and controls corresponding to the names of networks that can be connected (which depend on the "Wi-Fi" control). The "Bluetooth" page includes a toggle control for "Bluetooth" (which depends on the "Bluetooth" control) and controls corresponding to the names of devices that the user has connected to (which depends on the "Bluetooth" control) or the names of currently connectable devices (which depends on the "Bluetooth" control). And so on, we can obtain all pages that depend on the first page, the controls on each page, and the dependencies between each control, thus obtaining the navigation logic corresponding to the first page.

[0113] For example, the mobile phone can pre-extract the page information of all applications on the desktop, convert the page information of each page into page path information, and construct the corresponding jump logic for each page. This makes it easier for the mobile phone to directly obtain the jump logic corresponding to the currently displayed page and improve the speed of obtaining at least one task path of the first control as the first control based on the user's first task instruction.

[0114] As can be seen, the mobile phone can obtain the corresponding navigation logic of the first page based on the page information of the first page. Through the navigation logic and the user's first task instruction, it can obtain at least one task path of the first control. It is not necessary to take a screenshot of the mobile phone screen every time the page is navigated, nor is it necessary to send the screenshot to the server where the large language model is located for processing. The dependency relationship between controls can be obtained locally on the mobile phone through the navigation logic, which reduces the number of interactions between the mobile phone and the server and reduces the task execution time.

[0115] In some embodiments, when the mobile phone obtains at least one task path of the first control as the first control, the mobile phone sends a first task instruction and the jump logic corresponding to the first page to the server. Then, the mobile phone receives the last control sent by the server to complete the execution of the first task. Finally, the mobile phone obtains at least one task path of the first control as the first control based on the last control.

[0116] The last control used to complete the execution of the first task is obtained by the server based on the first task instruction and the corresponding jump logic of the first page.

[0117] For example, the large language model can obtain the user's first task instruction and the corresponding navigation logic for the first page. This means sending the first task instruction and navigation logic as a prompt to the large language model. The prompt's format can be as follows: Figure 10 As shown, the prompt consists of three parts. The first part tells the large language model (GLAM) to understand the user's intent and find the matching control from the logical jump (URM list). The second part tells the GLAM to divide the task corresponding to the user's intent into multiple logical stages sequentially. The third part tells the GLAM to send the necessary control identifiers to the mobile phone. Based on the prompt (the first task instruction and the jump logic corresponding to the first page), the GLAM identifies the user's intent and obtains the last control used to complete the execution of the first task. When the first task consists of multiple tasks, the GLAM can obtain the last control used to complete the execution of each task. The GLAM can be deployed locally on the mobile phone or on a cloud server. Therefore, the above-mentioned method of using a formatted language to extract page path information and construct lightweight jump logic (URM tree / URM model) can reduce the number of interactions between the mobile phone and the GLAM, thus reducing interaction costs and time.

[0118] For example, in the case where a large language model is deployed on a cloud-side server, such as Figure 11 As shown, the server hosting the large language model interacts with the mobile phone to obtain the first task command and navigation logic sent by the phone. Then, the large language model searches for the target option (performing user intent reasoning to obtain the controls the user expects to display). The determined controls are sent to the phone as an array. An array containing only one control is called a single-element array; an array containing two or more controls is called a multi-element array; and an array containing no controls is called an empty array. During the process of finding the target option, as... Figure 12As shown, when the large language model (MLM) detects only one task corresponding to the user's intent, it retrieves the last control corresponding to that single task and sends a single-element array of these last controls to the phone. The phone then retrieves the task path locally based on the last control. Alternatively, if the MLM detects multiple tasks corresponding to the user's intent, it retrieves the last control for each task and sends a multi-element array of these last controls to the phone. The phone then retrieves the task path for each task based on the array. If the MLM detects that the task corresponding to the user's intent does not exist, it sends an empty array to the phone. The phone can then display a message to inform the user that the corresponding task was not found, such as "Sorry, the item you mentioned does not exist." Therefore, the MLM is only used to infer the user's intent and retrieve the last control for completing the task; it is not used to retrieve the task path or execute the task. This reduces the inference time of the MLM and further improves its inference efficiency.

[0119] In this context, each task path in at least one task path represents a way of executing the first task.

[0120] For example, if the first page is a "Settings" page and the first task instruction is "Turn on Bluetooth", the server can send the inferred "Bluetooth" switch control used for "Turn on Bluetooth" to the mobile phone. After receiving the "Bluetooth" switch control, the mobile phone obtains the information from the first control (such as...). Figure 6 From the "Bluetooth" control in the middle to the last control (such as...) Figure 5 At least one task path consisting of multiple controls (such as the "Bluetooth" toggle control in the context) and other controls, such as... Figure 13 As shown, task path 1 is "Bluetooth" control - "Bluetooth" switch control, and task path 2 is "Bluetooth" control - desktop control - settings control - "Bluetooth" control - "Bluetooth" switch control.

[0121] As can be seen, the above method can obtain at least one task path either locally on the mobile phone or by interacting with the server, providing multiple ways to obtain at least one task path to meet different application scenarios and improve the applicability of task execution.

[0122] In some embodiments, the mobile phone obtains the first task path with the fewest controls from at least one task path.

[0123] For example, each of the at least one task path consists of multiple controls from the first control related to the first task on the first page to the last control that completes the first task. The first task path is the task path with the fewest controls among the at least one task paths. If there are multiple task paths with the fewest controls, the mobile phone can randomly select one of the task paths with the fewest controls.

[0124] As can be seen, the mobile phone can optimize the task path locally, and the task path with the fewest execution controls can further improve the task execution speed.

[0125] In some embodiments, the mobile phone includes a virtual screen, which is used to process the pages corresponding to each control on the first task path during the execution of the first task; the mobile phone can simulate user operations on the page processed by the virtual screen to trigger controls in the first task path, so that the virtual screen processes the page corresponding to the next control in the first task path; when the page processed by the virtual screen is the page corresponding to the last control on the first task path, the first task is completed.

[0126] For example, a virtual screen is a virtual space built by the phone beyond the phone's physical screen, not displayed to the user. The phone can simulate user actions on the virtual screen, triggering corresponding controls on the virtual screen to perform the primary task, such as... Figure 14 As shown, the first page is the desktop displayed on the phone's physical screen. The first task is to turn on Bluetooth. This task is performed on a virtual screen invisible to the user. After Bluetooth is turned on, the phone's physical screen displays the second page containing the "Bluetooth" toggle control. The processing on the virtual screen is as follows: Figure 15 As shown, the first task is to turn on Bluetooth. The first page is the phone's desktop. The path for the first task is settings control - "Bluetooth" control - "Bluetooth" switch control. On virtual screen 1, the user is simulated to click the settings control, resulting in virtual screen 2. On virtual screen 2, the user is simulated to click the "Bluetooth" control, resulting in virtual screen 3. On virtual screen 3, the user is simulated to click the "Bluetooth" switch control. After clicking the "Bluetooth" switch control, the first task of turning on Bluetooth is completed, and the phone displays the second page where the "Bluetooth" switch control is located.

[0127] As can be seen, by using a virtual screen to perform tasks and enabling click operations on the virtual screen, while hiding the intermediate pages that are redirected during the task execution process, the user can achieve seamless operation of the task and improve the user experience.

[0128] S503: After the first task is completed, the phone displays the second page containing the last control on the first execution path.

[0129] The first page and the second page may belong to the same application or different applications.

[0130] For example, the first task is to turn on Bluetooth. After the phone simulates the user clicking the "Bluetooth" switch control on virtual screen 3, the "Bluetooth" switch control on virtual screen 3 changes to "on," and the first task is completed. Then, the content on virtual screen 3 is rendered, and the phone displays it on the physical screen that can display the content. Figure 5 The second page shown has the "Bluetooth" switch control set to "On".

[0131] The steps S501-S503 described above implement the page display method in this application embodiment. When the mobile phone is performing a task, the mobile phone screen can jump from the current page to the page where the last control used to complete the task is located, reducing the process of jumping to different pages, realizing seamless operation for the user, and completing the task execution locally on the mobile phone, reducing the number of interactions between the mobile phone and the server, further improving the task execution speed and enhancing the user experience.

[0132] In some embodiments, when the first task is to enable the first function, the last control on the first execution path displayed on the second page is the control corresponding to the first function in the enabled state; when the first task is to disable the first function, the last control on the first execution path displayed on the second page is the control corresponding to the first function in the disabled state.

[0133] For example, the first task can be a task that changes the state of a control. The control displayed on the second page is the control after the first task is completed, that is, the control after the state has changed. The state can also be in the form of a value. For example, the first task is to store the weather for the next five days in a memo. The state of the "memo" control changes from the current value to the value corresponding to the newly added weather for the next five days.

[0134] As can be seen, mobile phones can automatically execute corresponding tasks by changing the state of controls, thereby automating mobile tasks and improving the user experience.

[0135] In some embodiments, during the execution of the first task, the mobile phone will also display a third page containing the control to be verified on the first task path.

[0136] Among them, the control to be verified is used to indicate the progress of the first task or to verify any one of the following: password, verification code, gesture, identity, or answer to a question.

[0137] It should be noted that the identity verification, such as face verification, used in the embodiments of this application is limited to obtaining information that is individually agreed upon by the individual, including but not limited to notifying and reminding the user to read the relevant user agreement (notification) and sign the agreement (authorization) which includes the authorization of relevant user information before the user uses the function.

[0138] It should be noted that the collection, storage, use, processing, transmission, provision and disclosure of user personal information involved in the technical solution disclosed in this application all comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0139] For example, the page displaying the control to be verified on the mobile phone can be used to prompt the user about the progress of the first task or to notify the user of the execution status of the first task. The user can choose not to perform any operation on the page displaying the control to be verified, thus satisfying the user's need to view intermediate navigation pages during task execution. In addition, the page displaying the control to be verified can also be used for verification. The user can operate on the page displaying the control to be verified so that the mobile phone can verify the content of the user's operation, which can improve the security of task execution.

[0140] For example, when the mobile phone is performing the first task on the virtual screen, if the control in the middle requires user verification, the page where the control is located can be displayed to the user so that the user can enter the verification credentials. The mobile phone can continue to perform the first task after obtaining the verification credentials and the verification is successful. If the mobile phone stops performing the first task after obtaining the verification credentials and the verification fails, a prompt message indicating the verification failure can be displayed.

[0141] As can be seen, by displaying the third page containing the control to be verified, the mobile phone can interact with the user, thereby improving the security of the first task execution.

[0142] In some embodiments, when the control to be verified is used to verify the password, the mobile phone can also receive the password entered by the user in the control to be verified on the third page. After the password is successfully verified, the mobile phone continues to execute the first task. After the first task is completed, the mobile phone displays the second page where the last control on the first execution path is located.

[0143] For example, the first task is to purchase product XXX in the shopping cart of XX software. When paying for the order, the user's password needs to be verified. The control corresponding to the password input can be displayed to the user. After the user enters the password, the mobile phone obtains the verification result corresponding to the password. After the verification result indicates successful verification, the mobile phone proceeds with the payment. After the payment is completed, the task of purchasing product XXX is completed, and the mobile phone displays the page where the payment for product XXX is completed.

[0144] It is evident that when encountering a password input control during task execution, it is necessary to display it to the user so that the user can enter the password, and continue task execution after successful password verification. This can improve the security of task execution, reduce user losses when the mobile phone is performing high-risk tasks, and increase user satisfaction with the automatic task execution function.

[0145] For example, when a task is executed automatically, the phone directly sends interaction events to the corresponding application (APP). When the virtual screen executes the task, it does not compete for focus with the phone's physical screen. In other words, user interaction with the phone does not affect task execution on the virtual screen. Traditional solutions, such as... Figure 16 As shown in (a), the agent corresponding to the large language model deployed on the server injects click events into the InputManagerService (IMS) on the mobile phone. Since the mobile phone has no focus in the background, it cannot receive the agent's click events. Therefore, IMS needs to find a window with focus in the WindowManagerService (WMS), and then the window with focus sends the click event to the top-level implementation ViewRootImpl of the view on the mobile APP. The mobile phone's display engine SurfaceFlinger will draw the page corresponding to the click event. For jump pages that do not need to be displayed, the mobile phone will also consume the phone's graphics processing unit (GPU) resources to draw.

[0146] The solution provided in the embodiments of this application is as follows: Figure 16 As shown in (b), the agent, as a local service of the mobile phone, directly sends click events to the window corresponding to the WMS of the mobile phone, and then the window sends click events to the ViewRootImpl on the corresponding mobile phone APP, which shortens the event processing flow. At the same time, the mobile phone's display engine draws the page to be displayed. The page to be displayed includes the page where the control to be verified is located and the page where the last control used to complete the task is located. The jump page during task execution is not drawn, which reduces the consumption of mobile phone GPU resources.

[0147] For example, a complete flowchart of the page display method provided in this application embodiment is as follows: Figure 17 As shown, the user issues the first task command to turn on Bluetooth. The first page currently displayed on the phone is the desktop. The navigation logic corresponding to the desktop is obtained and stored. The first task command and the corresponding navigation logic are sent to the large language model. The large language model obtains the last control of the first task corresponding to the user's first task command, obtains the first task path based on the last control, executes the first task corresponding to the first task path on the virtual screen, and after the first task is completed, draws the second page where the last control is located, and the phone displays the second page.

[0148] It is understood that, in order to achieve the above functions, the aforementioned electronic device includes hardware and / or software modules corresponding to perform each function. Based on the algorithmic steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0149] This application embodiment can divide the electronic device into functional modules according to the above method example. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0150] This application also provides an electronic device, such as... Figure 18 As shown, the electronic device may include one or more processors 1801, memory 1802, and communication interfaces 1803.

[0151] The memory 1802, communication interface 1803, and processor 1801 are coupled together. For example, the memory 1802, communication interface 1803, and processor 1801 can be coupled together via bus 1804.

[0152] The communication interface 1803 is used for data transmission with other devices. The memory 1802 stores computer program code. The computer program code includes computer instructions, which, when executed by the processor 1801, cause the electronic device to perform the page display method described in this embodiment.

[0153] The processor 1801 may be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with this disclosure. The processor may also be a combination that implements computational functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0154] The bus 1804 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. The aforementioned bus 1804 can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 18 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0155] This application also provides a computer-readable storage medium storing computer program code. When the processor executes the computer program code, the electronic device executes the relevant method steps in the above method embodiments.

[0156] The electronic devices and computer storage media provided in this application are used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects of the corresponding methods provided above, and will not be repeated here.

[0157] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0158] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0159] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0160] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0161] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, in essence, or the part that contributes, or all or part of the technical solution, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0162] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions within the technical scope disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. A page display method, characterized in that, include: Display the first page; In response to the user's first task instruction, obtain the first task path corresponding to the first page; The first task path is used to indicate the execution of the first task corresponding to the first task instruction; the first task path includes at least two controls that have a dependency relationship and are related to the first task; after the functions or tasks corresponding to the at least two controls are executed sequentially, the first task is completed. After the first task is completed, the second page containing the last control on the first execution path is displayed.

2. The method according to claim 1, characterized in that, The first page includes at least one control; the step of obtaining the first task path corresponding to the first page in response to the user's first task instruction includes: Obtain the first control related to the first task from at least one control on the first page; Obtain at least one task path for the first control as the first control; each task path in the at least one task path represents a way of executing the first task; Choose the first task path with the fewest controls from the at least one task path.

3. The method according to claim 1 or 2, characterized in that, The method further includes: During the execution of the first task, a third page is displayed containing the control to be verified on the path of the first task; the control to be verified is used to indicate the execution progress of the first task or to verify any one of the following: password, verification code, gesture, identity, or answer to a question.

4. The method according to claim 3, characterized in that, When the control to be verified is used to verify a password, the method further includes: Receive the password entered by the user in the control to be verified on the third page; After the password is successfully verified, continue executing the first task; After the first task is completed, the second page containing the last control on the first execution path is displayed.

5. The method according to any one of claims 1-4, characterized in that, The method is applied to an electronic device, the electronic device including a virtual screen, the virtual screen being used to process the pages corresponding to various controls on the first task path during the execution of the first task; the method further includes: On the page processed by the virtual screen, the user's operation is simulated to trigger the control in the first task path, so that the virtual screen processes the page corresponding to the next control in the first task path; when the page processed by the virtual screen is the page corresponding to the last control in the first task path, the first task is completed.

6. The method according to claim 2, characterized in that, The step of obtaining at least one task path for the first control as the first control includes: Obtain page information of the first page; the page information includes the attributes and state of each control in at least one control on the first page; Based on the page information of the first page, obtain the jump logic corresponding to the first page; the jump logic is used to indicate at least one page involved in completing the first task, the controls on each page, and the dependencies between each control; Based on the first task instruction and the jump logic, obtain at least one task path where the first control is the first control.

7. The method according to any one of claims 1-6, characterized in that, When the first task is to enable the first function, the last control on the first execution path displayed on the second page is the control corresponding to the first function in the enabled state; when the first task is to disable the first function, the last control on the first execution path displayed on the second page is the control corresponding to the first function in the disabled state.

8. The method according to claim 6, characterized in that, The step of obtaining at least one task path for the first control as the first control includes: Send the first task instruction and the redirection logic corresponding to the first page to the server; The server receives the last control sent by the server to complete the execution of the first task; the last control for completing the execution of the first task is obtained by the server according to the first task instruction and the jump logic corresponding to the first page. Based on the last control, obtain at least one task path for the first control as the first control.

9. The method according to any one of claims 1-8, characterized in that, The first page and the second page belong to the same application or different applications.

10. An electronic device, characterized in that, The device includes a memory and one or more processors; the memory is coupled to the processors; wherein the memory stores computer program code, the computer program code including computer instructions, which, when executed by the processor, cause the electronic device to perform the page display method as described in any one of claims 1-9.

11. A computer-readable storage medium, characterized in that, Includes computer instructions that, when executed on an electronic device, cause the electronic device to perform the page display method as described in any one of claims 1-9.

12. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the page display method as described in any one of claims 1-9.

Images