Display method of artificial intelligence interface and terminal device

Abstract

The embodiment of the application provides a display method of an artificial intelligence interface, a terminal device and a computer readable storage medium, wherein, in the display method of the artificial intelligence interface, after the interface of the target application is displayed, the terminal device acquires target content selected by a user in the interface of the target application, in response to the operation that the user drags the target content to the edge of the screen of the terminal device and hovers, an AI interface is displayed, the AI interface provides one or more AI capabilities, and the AI capabilities are used for processing the target content, so that the terminal device can display the AI interface in response to the operation of the user, the user can conveniently and quickly use the AI capabilities without having to have a conversation with an AI tool, and user experience is improved.

Description

Technical Field

[0001] This application relates to the field of smart terminal technology, and in particular to a method for displaying an artificial intelligence interface and a terminal device. Background Technology

[0002] In existing related technologies, some applications, after being adapted to artificial intelligence (AI) tools, can provide AI capabilities during application operation. For example, the terminal device can display the interface of the AI ​​tool in the right area of ​​the current display screen, and perform corresponding operations based on the information entered by the user in the AI ​​tool interface.

[0003] However, in the above solutions, users need to interact with the AI ​​to use its capabilities, and they can only use the pre-set functions of the AI ​​tool, resulting in a poor user experience. In addition, the above solutions are only applicable to personal computers (PCs) or tablets, and not to mobile devices such as smartphones. Summary of the Invention

[0004] This application provides a method for displaying an artificial intelligence interface and a terminal device. This application also provides a computer-readable storage medium to enable the terminal device to respond to user operations and display an AI interface, so that users can conveniently and quickly use AI capabilities and improve user experience.

[0005] In a first aspect, embodiments of this application provide a method for displaying an artificial intelligence interface, comprising: displaying an interface of a target application; acquiring target content selected by a user in the interface of the target application; and, in response to the user dragging the target content to the edge of the screen of a terminal device and hovering it, displaying an artificial intelligence interface, wherein the artificial intelligence interface provides one or more artificial intelligence capabilities for processing the target content.

[0006] In the above-mentioned method for displaying the AI ​​interface, after displaying the interface of the target application, the terminal device obtains the target content selected by the user in the interface of the target application. In response to the user's operation of dragging the target content to the edge of the terminal device's screen and hovering it, the AI ​​interface is displayed. The AI ​​interface provides one or more AI capabilities to process the target content, thereby enabling the terminal device to display the AI ​​interface in response to the user's operation. This allows the user to conveniently and quickly use AI capabilities without having to interact with the AI ​​tool, thus improving the user experience.

[0007] In one possible implementation, the AI ​​interface can be displayed by showing at least one predetermined AI option.

[0008] In one possible implementation, the AI ​​interface can be displayed by: showing at least one AI option in the AI ​​interface based on the type of the target application and / or the type of the target content; or, showing at least one AI option in the AI ​​interface based on the type of the target application and / or the type of the target content, combined with user habits.

[0009] In one possible implementation, displaying the artificial intelligence interface includes: displaying the artificial intelligence interface from the edge of the terminal device's screen toward the center of the terminal device's screen.

[0010] In one possible implementation, the AI ​​interface can be displayed by showing the target application's interface and the AI ​​interface side-by-side in the same window.

[0011] In one possible implementation, the display of the artificial intelligence interface can be achieved by splitting the target application's interface with the artificial intelligence interface into two screens or displaying them in multiple windows.

[0012] This display method fully leverages the advantages of widescreen devices, showcasing the AI ​​interface while minimizing disruption to the target application interface, thus enabling simultaneous display of both. Widescreen devices include tablets and foldable devices in their unfolded state.

[0013] One possible implementation is to display the AI ​​interface on top of the target application's interface.

[0014] In one possible implementation, after the AI ​​interface is displayed on top of the target application's interface, the terminal device 100 can also respond to the user's operation of dragging the AI ​​interface to the edge of the terminal device's screen to split the AI ​​interface and the target application's interface into a single screen.

[0015] In one possible implementation, after displaying the AI ​​interface, the terminal device 100 can also respond to the user's triggering of a minimized display operation by switching the AI ​​interface to a minimized state.

[0016] In one possible implementation, after displaying the artificial intelligence interface, based on the user's operation of dragging the target content to the target option in at least one of the aforementioned artificial intelligence options and releasing it, the target content is processed through the artificial intelligence capabilities provided by the target option to obtain the first content corresponding to the target content.

[0017] In one possible implementation, after obtaining the first content corresponding to the target content, the terminal device can further increase the display area of ​​the target option; and display the first content in the increased display area.

[0018] In one possible implementation, the AI ​​capabilities provided by the aforementioned AI interface include the capabilities of the target application and / or the services provided by the target application.

[0019] In one possible implementation, the AI ​​interface described above can provide one or more AI capabilities, including:

[0020] Artificial intelligence capabilities provided by the operating system of the terminal device;

[0021] Services provided by the operating system of the terminal device;

[0022] The ability of the terminal device's operating system to combine its artificial intelligence capabilities with services within other applications;

[0023] Services provided by other applications;

[0024] Artificial intelligence capabilities provided by other applications;

[0025] Among them, the aforementioned other applications are third-party applications, and these other applications are different from the target application.

[0026] In one possible implementation, after displaying the target application's interface, the terminal device 100 can also display an artificial intelligence interface in response to a user's triggered operation on the target application's interface.

[0027] Secondly, embodiments of this application provide a terminal device, including: one or more processors; a memory; multiple applications; and one or more computer programs, wherein the one or more computer programs are stored in the memory, and the one or more computer programs include instructions that, when executed by the terminal device, cause the terminal device to perform the method provided in the first aspect.

[0028] It should be understood that the second aspect of the embodiments of this application is consistent with the technical solution of the first aspect of the embodiments of this application, and the beneficial effects achieved by each aspect and the corresponding feasible implementation are similar, and will not be described again.

[0029] Thirdly, embodiments of this application provide a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to perform the method provided in the first aspect.

[0030] Fourthly, embodiments of this application provide a computer program product, which includes a computer program that, when run on a computer, causes the computer to perform the method provided in the first aspect.

[0031] In one possible design, the program in the fourth aspect can be stored wholly or partially on a storage medium packaged with the processor, or it can be stored wholly or partially on a memory not packaged with the processor. Attached Figure Description

[0032] Figure 1 A schematic diagram of an AI tool provided for existing related technologies;

[0033] Figure 2 A schematic diagram of another AI tool provided for existing related technologies;

[0034] Figure 3 This is a schematic diagram of the structure of a terminal device provided in one embodiment of this application;

[0035] Figure 4 A flowchart illustrating a method for displaying an artificial intelligence interface according to an embodiment of this application;

[0036] Figure 5 A schematic diagram illustrating the display of an AI interface according to one embodiment of this application;

[0037] Figure 6 A schematic diagram of a display AI interface provided for another embodiment of this application.

[0038] Figure 7 A schematic diagram illustrating the display of an AI interface provided in yet another embodiment of this application;

[0039] Figure 8 A schematic diagram illustrating the display of an AI interface provided in yet another embodiment of this application;

[0040] Figure 9(a) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0041] Figure 9(b) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0042] Figure 9(c) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0043] Figure 9(d) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0044] Figure 9(e) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0045] Figure 9(f) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0046] Figure 9(g) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0047] Figure 10 A schematic diagram illustrating the display of an AI interface provided in yet another embodiment of this application;

[0048] Figure 11 A schematic diagram illustrating the display of an AI interface provided in yet another embodiment of this application;

[0049] Figure 12 A schematic diagram illustrating the display of an AI interface provided in yet another embodiment of this application;

[0050] Figure 13 A schematic diagram showing another embodiment of this application;

[0051] Figure 14(a) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0052] Figure 14(b) is a schematic diagram of an AI interface provided in another embodiment of this application;

[0053] Figure 15 This is a schematic diagram of the structure of a terminal device provided in another embodiment of this application. Detailed Implementation

[0054] The terminology used in the implementation section of this application is for the purpose of explaining specific embodiments of this application only, and is not intended to limit this application.

[0055] In existing related technologies, some applications, after being adapted to AI tools, can provide AI capabilities during application operation. One existing technical solution, such as... Figure 1 As shown, when a user is editing a document, they can interact with the AI ​​on the right to assist with operations on the document on the left. Figure 1 A schematic diagram of an AI tool provided for existing related technologies.

[0056] However, in this technical solution, the capabilities of the AI ​​tools are pre-set, and users need to interact with the AI ​​to use the corresponding AI capabilities.

[0057] In another existing technical solution, such as Figure 2 As shown, the right side of the current display interface on the terminal device shows some auxiliary AI functions that can help users better perform operations such as generating images and / or visual processing of images. See also Figure 2 When a user enters "Inspiration" in the middle area of ​​the current display interface, the AI ​​tool on the right can generate an image based on the user's input, such as... Figure 2 Images of giraffes in China. Figure 2This is a diagram illustrating another AI tool provided by existing related technologies. However, this AI tool is inconvenient to interact with in emergency situations, overly forceful to the user, and... Figure 1 The solution shown is similar; users can only use the functions pre-set by the AI ​​tool.

[0058] Furthermore, both of the aforementioned AI tools are only compatible with PCs or tablets, and not with mobile devices such as smartphones. Additionally, both AI tools require an application to provide an entry point; the tools can only be used during application operation after the application is compatible with them.

[0059] To address the above issues, this application provides a method for displaying an artificial intelligence interface, which can respond to user operations by displaying an AI interface on the terminal device, allowing users to conveniently and quickly use AI capabilities without having to interact with the AI ​​tool, thereby improving the user experience.

[0060] The artificial intelligence interface display method provided in this application embodiment can be applied to terminal devices, wherein the terminal devices can be smartphones, tablets, wearable devices, in-vehicle devices, augmented reality (AR) / virtual reality (VR) devices, laptops, ultra-mobile personal computers (UMPCs), netbooks, or personal digital assistants (PDAs), etc.; this application embodiment does not impose any restrictions on the specific type of terminal device.

[0061] For example, Figure 3 This is a schematic diagram of the structure of a terminal device provided in one embodiment of this application, as shown below. Figure 3As shown, the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, a headphone jack 170D, a sensor module 180, buttons 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, a barometric pressure sensor 180C, a magnetic sensor 180D, an accelerometer sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0062] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the terminal device 100. In other embodiments of this application, the terminal device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0063] Processor 110 may include one or more processing units, such as application processors (APs), modem processors, graphics processing units (GPUs), image signal processors (ISPs), controllers, video codecs, digital signal processors (DSPs), baseband processors, and / or neural network processing units (NPUs). These different processing units may be independent devices or integrated into one or more processors.

[0064] The controller can generate operation control signals based on the instruction opcode and timing signals to complete the control of instruction fetching and execution.

[0065] The processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. This memory can store instructions or data that the processor 110 has just used or that are used repeatedly. If the processor 110 needs to use the instruction or data again, it can retrieve it directly from the memory. This avoids repeated accesses, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0066] Terminal device 100 implements display functions through a GPU, display screen 194, and application processor. The GPU is a microprocessor for image processing, connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and for graphics rendering. Processor 110 may include one or more GPUs, which execute program instructions to generate or modify display information.

[0067] Display screen 194 is used to display images, videos, etc. Display screen 194 includes a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a Miniled LED, a MicroLED, a Micro-OLED, a quantum dot light-emitting diode (QLED), etc. In some embodiments, terminal device 100 may include one or N displays 194, where N is a positive integer greater than 1.

[0068] Touch sensor 180K, also known as a "touch device," can be located on display screen 194. The touch sensor 180K and display screen 194 together form a touchscreen, also known as a "touchscreen." Touch sensor 180K detects touch operations applied to or near it. The touch sensor can transmit the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through display screen 194. In other embodiments, touch sensor 180K may also be located on the surface of terminal device 100, in a different position than display screen 194.

[0069] For ease of understanding, the following embodiments of this application will be described using the following methods: Figure 3Taking the terminal device with the structure shown as an example, and in conjunction with the accompanying drawings and application scenarios, the display method of the artificial intelligence interface provided in this application embodiment will be specifically described.

[0070] Figure 4 This is a flowchart of a method for displaying an artificial intelligence interface according to an embodiment of this application. The method provided in this embodiment can be executed by a terminal device 100.

[0071] like Figure 4 As shown, the display method of the above-mentioned artificial intelligence interface may include:

[0072] Step 401: Display the interface of the target application.

[0073] The target application can be the target application currently running in the foreground on the terminal device 100.

[0074] Step 402: Obtain the target content selected by the user in the target application's interface.

[0075] Step 403: In response to the user dragging the target content to the edge of the screen of the terminal device 100 and hovering it, the AI ​​interface is displayed.

[0076] The AI ​​interface described above provides one or more AI capabilities for processing the target content. This embodiment does not limit the specific form of the AI ​​interface, as long as it can implement one or more AI functions. AI functions may include, for example, voice interaction agents (such as Xiaoyi, Xiao Ai, etc.), intelligent translation, intelligent document summarization, intelligent search, intelligent storage, etc. This application does not limit the AI ​​functions.

[0077] Figure 5 This is a schematic diagram illustrating the display of an AI interface provided in one embodiment of this application, such as... Figure 5 As shown, Figure 5 (a) is the interface of the target application on the terminal device 100. After the user selects the target content 51 in the interface of the target application, the user drags the target content 51 to the edge of the screen of the terminal device 100 and hovers it, such as... Figure 5 As shown in (b). In response to the user dragging the target content 51 to the edge of the screen of the terminal device 100 and hovering it, the terminal device 100 displays the AI ​​interface, as shown in (b). Figure 5 (c) and Figure 5 As shown in (d). From Figure 5 (c) and Figure 5 (d) It can be seen that terminal device 100 first displays the AI ​​interface, such as Figure 5 As shown in 52 of (c), then Figure 5 (c) The AI ​​interface 52 shown displays thumbnails of one or more AI options, such as Figure 5As shown in (c) 53, one or more AI options are then fully displayed on the AI ​​interface, such as Figure 5 As shown in (d) 54. Each of the above AI options can provide an AI capability. The AI ​​option can be presented in the form of an AI agent card or in other forms. This embodiment does not limit the presentation form of the AI ​​option, but this embodiment uses the form of an AI agent card as an example for illustration. Figure 5 (d) shows three AI options, which provide AI agent capabilities 1, 2, and 3, respectively. Figure 5 (d) This is only an example, and the number of AI options displayed in the AI ​​interface is not limited in this embodiment.

[0078] In some examples, the AI ​​interface can be displayed by showing at least one predetermined AI option. In this example, the AI ​​capability provided by the predetermined AI option can be the default AI agent capability provided by the operating system of terminal device 100. For example, if the default AI agent capability of the operating system of terminal device 100 includes search, translation, and image editing, then each time the user drags the target content to the edge of the screen of terminal device 100 and hovers it, terminal device 100 will display three AI options in the AI ​​interface, and the AI ​​capabilities provided by these three AI options are search, translation, and image editing, respectively.

[0079] In other examples, the AI ​​interface may display at least one AI option based on the type of the target application and / or the type of the target content; or, based on the type of the target application and / or the type of the target content, combined with user habits, at least one AI option may be displayed. The following provides an example of displaying at least one AI option in the AI ​​interface.

[0080] Depending on the type of target content, at least one AI option can be displayed in the AI ​​interface. When the target content is text, the AI ​​agent capabilities provided by the above at least one AI option may include one or a combination of the following: translation, parsing, making a phone call, extracting / collecting, temporary saving, etc. When the target content is an image, the AI ​​agent capabilities provided by the above at least one AI option may include one or a combination of the following: searching for similar items, shopping by image, beautifying images, extracting text, etc.

[0081] by Figure 5(d) For example, when the target content is text, AI agent capability 1 can translate, AI agent capability 2 can parse, and AI agent capability 3 can extract / collect; when the target content is an image, AI agent capability 1 can search for similar products, AI agent capability 2 can shop by image, and AI agent capability 3 can beautify images.

[0082] Depending on the type of the target application, at least one AI option may be displayed in the AI ​​interface. When the target application is a news application, the AI ​​agent capabilities provided by the above-mentioned at least one AI option may include one or a combination of the following: search, translation, excerpting / collecting.

[0083] Depending on the type of the target application and the type of the target content, at least one AI option can be displayed in the AI ​​interface. When the target application is a news application and the target content is text, the AI ​​agent capabilities provided by the above-mentioned at least one AI option can include one or a combination of the following: search, translation, excerpting / collection.

[0084] Depending on the type of target application and user habits, displaying at least one AI option in the AI ​​interface could be as follows: For example, if a user habitually uses a search engine when browsing news, then when the target application is a news application, the terminal device 100 could display only one AI option. This AI option could provide AI agent capabilities such as search. Figure 6 As shown, Figure 6 This is a schematic diagram illustrating the display of an AI interface according to another embodiment of this application. See also... Figure 6 ,same Figure 6 (a) is the display interface of the target application currently running in the foreground. Figure 6 In (a), the target application is a news application, when the user is... Figure 6 In the interface shown in (a), select the target content 61, drag it to the edge of the terminal device 100 and hover it (as shown in the image). Figure 6 (b) After that, the terminal device 100 displays the AI ​​interface 62, as shown. Figure 6 (c) shows the AI ​​options thumbnails 63 displayed in the AI ​​interface 62. Since users are accustomed to using search engines when browsing news, therefore... Figure 6 In (c), only a thumbnail of one AI option is displayed. A full illustration of the AI ​​option is shown below. Figure 6 As shown in (d) 64, the AI ​​agent capability provided by AI option 64 is search.

[0085] Additionally, see also Figure 5 (d), Figure 5(d) The AI ​​interface on the right can be pinned. Once pinned, the AI ​​interface will remain on top. When the user swipes on the screen, the content displayed on the left side of the screen will scroll, while the AI ​​interface on the right side will not scroll.

[0086] Figure 5 (d) The AI ​​interface on the right can also be set to the system level. After setting, the left side of the screen can switch to display different application interfaces, but the AI ​​interface on the right will not switch.

[0087] In addition, for Figure 5 (d) Regarding the AI ​​interface on the right, users can long press AI interface 52 or AI option 54 to trigger the sorting of AI options. After sorting the AI ​​options, users can choose to apply the sorting to applications in the same vertical category, or they can choose to apply the sorting only to the currently running target application.

[0088] Furthermore, users can drag and drop content into the AI ​​options on the right, allowing them to save that content to their favorites. They can also open the AI ​​Favorites section within the AI ​​options to view their saved content.

[0089] In some other examples, the AI ​​interface displayed on the terminal device 100 may be displayed from the edge of the screen of the terminal device 100 toward the center of the screen.

[0090] The screen edge of the aforementioned terminal device 100 can be either the left or right edge of the screen, such as... Figure 5 (d) or Figure 6 As shown in (d), the AI ​​interface is displayed from the right edge of the screen of terminal device 100 towards the center of the screen. Alternatively, the screen edge of terminal device 100 can be the top or bottom edge of the screen, such as... Figure 7 As shown, the AI ​​interface is displayed from the lower edge of the screen of the terminal device 100 toward the center of the screen. Figure 7 This is a schematic diagram of a display AI interface provided in another embodiment of this application.

[0091] In some other examples, the AI ​​interface displayed on the terminal device 100 can be: the target application's interface and the aforementioned AI interface are displayed side-by-side in the same window, such as... Figure 8 As shown, Figure 8 This is a schematic diagram illustrating the display of an AI interface according to another embodiment of this application. Figure 8 It can be seen that, Figure 8 The AI ​​interface is displayed in the right panel of window 81, and the target application's interface is displayed in the left panel of window 81. However, this method requires modification of the target application's interface, increasing the adaptation cost of the target application.

[0092] In some examples, the terminal device 100 displays the AI ​​interface by splitting the target application's interface and the AI ​​interface into two windows, as shown in Figure 9(a). Figure 9(a) is a schematic diagram of displaying the AI ​​interface provided in another embodiment of this application. In Figure 9(a), the target application's interface and the AI ​​interface are displayed in two separate windows (the target application's interface is displayed in window 91, and the AI ​​interface is displayed in window 92) through a multi-window or split-screen architecture. This eliminates the need to modify the target application's interface, reducing the adaptation cost of the target application. Figure 9(a) shows two split-screen display methods: the left image shows a left-right split-screen, and the right image shows a top-bottom split-screen. The terminal device 100 can save the split-screen method. For example, assuming that the target application's interface and the AI ​​interface are currently displayed in a left-right split-screen, then the target application's interface and the AI ​​interface will still be displayed in a left-right split-screen next time.

[0093] In some examples, the AI ​​interface displayed by the terminal device 100 can be: displayed on top of the target application's interface. Figure 9(b) is a schematic diagram of displaying the AI ​​interface provided in another embodiment of this application. As shown in Figure 9(b), the leftmost figure is the target application's interface of the terminal device 100. After the user selects target content 93 in the target application's interface, the user drags the target content 93 to the edge of the terminal device 100's screen and hovers it. In response to the user's operation of dragging the target content 93 to the edge of the terminal device 100's screen and hovering it, the terminal device 100 first displays a thumbnail 94 of the AI ​​interface. The thumbnail 94 of the AI ​​interface displays one or more thumbnails of AI options, as shown in 95. Then, the AI ​​interface is displayed on top of the target application's interface in the form of an independent window, as shown in 96. The AI ​​interface 96 fully displays one or more AI options, as shown in 97. Similarly, each of the above AI options can provide an AI capability. This AI option can be presented in the form of an AI agent card or in other forms. This embodiment does not limit the presentation form of the AI ​​options, but this embodiment uses the form of an AI agent card as an example for illustration. The AI ​​interface 96 in Figure 9(b) shows three AI options. The AI ​​capabilities provided by these three AI options are AI agent capability 1, AI agent capability 2, and AI agent capability 3, respectively. Of course, Figure 9(b) is only an example, and this embodiment does not limit the number of AI options displayed in the AI ​​interface.

[0094] In these examples, after the AI ​​interface is displayed as a separate window above the target application's interface, the user can adjust the size of the AI ​​interface by dragging it, and / or the AI ​​interface size can be provided with different default sizes depending on the target application. That is, different sizes of AI interfaces can be provided for different target applications, and then the user can adjust the size of the AI ​​interface according to their own needs during actual use; or, the size of the AI ​​interface can be the same for different target applications, and the user can adjust the size of the AI ​​interface according to their own needs during actual use.

[0095] Figure 9(c) is a schematic diagram of an AI interface provided in another embodiment of this application. As can be seen from the two figures in Figure 9(c), the sizes of AI interface 98 and AI interface 99 are different. For the same target application, the user can adjust the size of the AI ​​interface according to their own needs during actual use.

[0096] Furthermore, Figure 9(d) is a schematic diagram of an AI interface display provided in another embodiment of this application. As shown in Figure 9(d), the AI ​​interface has different window forms depending on the scenario. Figure 9(d) shows four different window forms of the AI ​​interface. Of course, these four window forms are merely examples and do not constitute a limitation on the embodiments of this application.

[0097] In addition, the AI ​​interface can automatically be minimized if no processing is performed, as shown in Figure 9(e). Figure 9(e) is a schematic diagram of the display of the AI ​​interface provided in another embodiment of this application.

[0098] Furthermore, after the AI ​​interface is displayed on top of the target application's interface, in response to the user dragging the AI ​​interface to the edge of the terminal device 100's screen, the AI ​​interface and the target application's interface are displayed in a split-screen manner. Figure 9(f) is a schematic diagram of displaying the AI ​​interface according to another embodiment of this application. As shown in Figure 9(f), when the user drags the AI ​​interface to the edge of the terminal device 100's screen, the terminal device 100 displays the AI ​​interface and the target application's interface in a split-screen manner. In Figure 9(f), the example of displaying the AI ​​interface and the target application's interface in a split-screen manner is used, but this embodiment is not limited to this. In one implementation, referring to the description in the embodiment shown in FIG9(a), in response to the user dragging the AI ​​interface to the edge of the screen of the terminal device 100, the terminal device 100 can display the AI ​​interface and the target application interface in a left-right split-screen manner according to the saved split-screen method. If the AI ​​interface and the target application interface were previously displayed in a left-right split-screen manner, then the terminal device 100 will display the AI ​​interface and the target application interface in a left-right split-screen manner this time. If the AI ​​interface and the target application interface were previously displayed in a top-bottom split-screen manner, then the terminal device 100 will display the AI ​​interface and the target application interface in a top-bottom split-screen manner this time. In another implementation, the terminal device 100 can determine the screen splitting method based on which edge of the screen the user drags the AI ​​interface to. For example, if the user drags the AI ​​interface to the left or right edge of the screen, the terminal device 100 will display the AI ​​interface and the target application interface in a left-right splitting method, as shown in the right side of Figure 9(f) or the left side of Figure 9(a). If the user drags the AI ​​interface to the top or bottom edge of the screen, the terminal device 100 will display the AI ​​interface and the target application interface in an up-down splitting method, as shown in the right side of Figure 9(a).

[0099] In some examples, after the terminal device 100 displays the AI ​​interface, in response to the user triggering a minimize operation, the terminal device 100 switches the AI ​​interface to a minimized state. The user triggering the minimize operation can be clicking the minimize icon in the AI ​​interface; however, this embodiment is not limited to this, and the specific user-triggered minimize operation is not restricted. Figure 9(g) is a schematic diagram of displaying an AI interface according to another embodiment of this application. As shown in the left side of Figure 9(g), the AI ​​interface includes a minimize icon 910. In response to the user clicking the minimize icon 910, the terminal device 100 switches the AI ​​interface to a minimized state, as shown in 911.

[0100] In some other examples, after step 403, based on the user's operation of dragging the target content to a target option in at least one AI option and releasing it, the terminal device 100 processes the target content using the AI ​​capabilities provided by the target option to obtain the first content corresponding to the target content.

[0101] After obtaining the first content corresponding to the target content, the terminal device 100 can increase the display area of ​​the target option and display the first content in the increased display area. Figure 10 This is a schematic diagram illustrating the display of an AI interface according to another embodiment of this application. See also... Figure 10 After the terminal device 100 displays the AI ​​interface, if the user drags the target content to at least one target option in the AI ​​options, the terminal device 100 can process the target content using the AI ​​capabilities provided by the target option. Figure 10 In the target option, the AI ​​capability provided is AI agent capability 2. After the terminal device 100 processes the target content through AI agent capability 2, it obtains the first content corresponding to the target content. Then, the terminal device 100 can increase the display area of ​​the target option and display the first content in the increased display area, as shown in 1002.

[0102] Of course, it is understandable that if the content of the first option is small and can be displayed sufficiently in the original display area of ​​the target option, then the display area of ​​the target option does not need to be increased, and it can be displayed directly in the original display area of ​​the target option.

[0103] In some examples, the AI ​​capabilities provided by the AI ​​interface may include the capabilities of the target application and / or the services provided by the target application. That is, in this embodiment, the AI ​​interface can combine the capabilities of the application, specifically in two ways. One approach is to combine the capabilities of the target application with the capabilities of the AI ​​agent to generate unique AI options (AI agents) that incorporate the application's capabilities, such as insightful comments, etc. Figure 11 As shown, Figure 11 This is a schematic diagram of a display AI interface provided in another embodiment of this application. Figure 11 In the example, the AI ​​option shown in 1101 provides AI capabilities that combine AI agent capabilities with the capabilities of the target application.

[0104] Another approach is to integrate the target application's capabilities into the AI ​​agent architecture. For example, integrating the target application's high-frequency capabilities, such as liking and / or saving, into the AI ​​agent architecture. Figure 12 As shown, Figure 12 1201 refers to the capabilities of the target application being accessed. Figure 12 This is a schematic diagram of a display AI interface provided in another embodiment of this application.

[0105] In other examples, one or more AI capabilities provided by the AI ​​interface may include:

[0106] The artificial intelligence capabilities provided by the operating system of terminal device 100;

[0107] Services provided by the operating system of terminal device 100;

[0108] The operating system of terminal device 100 provides artificial intelligence capabilities that can be combined with services within other applications;

[0109] Services provided by other applications;

[0110] Artificial intelligence capabilities provided by other applications.

[0111] Here, "other applications" refers to third-party applications, which are different from the target application. Specifically, third-party applications are applications created by independent developers or companies that have no direct relationship with the device manufacturer or operating system developer. If the target application is also a third-party application, then "other applications" are third-party applications installed on terminal device 100 that are different from the target application. If the target application is not a third-party application, for example, if the third-party application is a system application of terminal device 100, then "other applications" are third-party applications, and obviously, they are different from the target application.

[0112] Specifically, in one implementation method, using Figure 5 (d) For example, the AI ​​capabilities provided by the AI ​​option in the AI ​​interface can be the AI ​​agent capabilities provided by the operating system of the terminal device 100, and / or the services provided by the operating system of the terminal device 100.

[0113] In another implementation, see Figure 13 (a) The AI ​​capabilities provided by the AI ​​options in the AI ​​interface may include the AI ​​capabilities provided by the operating system of the terminal device 100 (as shown in 1301), the ability of the AI ​​capabilities provided by the operating system of the terminal device 100 to combine with services in other applications (as shown in 1302), and services provided by other applications (as shown in 1303).

[0114] See Figure 13 (b) The AI ​​capabilities provided by the AI ​​option in the AI ​​interface can be AI capabilities provided by other applications, as shown in 1304. Figure 13 This is a schematic diagram of a display smart agent card provided in another embodiment of this application.

[0115] Additionally, the aforementioned AI options can be exposed as a control capability, allowing third-party applications to provide this capability. During the user's use of the target application, the user can invoke the AI ​​agent capability provided by a third-party application different from the target application. Figure 14(a) is a schematic diagram of the AI ​​interface display provided in another embodiment of this application. Referring to Figure 14(a), assuming the user is currently using a news application, the left side of Figure 14(a) shows the display interface of the news application currently running in the foreground, and the right side of Figure 14(a) can display the AI ​​agent capability provided by the instant messaging application invoked by the user. As shown in 1401, when browsing news, the user can chat with contacts in the instant messaging application through the AI ​​agent capability of the instant messaging application.

[0116] In another implementation of this embodiment, after step 401, the terminal device 100 displays the AI ​​interface in response to a user's triggering operation on the target application's interface. That is, this implementation provides another way to trigger the terminal device 100 to display the AI ​​interface. In some examples, the aforementioned user triggering operation on the target application's interface can be a user clicking a control on the target application's interface, as shown in Figure 14(b). Figure 14(b) is a schematic diagram of displaying the AI ​​interface provided in yet another embodiment of this application. Figure 14(b) on the left shows the display interface of a news application currently running in the foreground. The interface on the left includes a smart summary control 1402. Clicking control 1402 triggers the terminal device 100 to display the AI ​​interface shown on the right of Figure 14(b). The AI ​​interface on the right includes two AI options: one providing "smart summary" and the other providing "smart search." The AI ​​interface on the right also provides an "add to favorites" function. Users can select target content in the news application's display interface and add it to their favorites. They can also open the AI ​​favorites in the AI ​​options to view historical favorites. Furthermore, comparing the left and right images of Figure 14(b), it can be seen that after the AI ​​interface is displayed in the right image of Figure 14(b), control 1402 is no longer displayed in the news application's display interface.

[0117] In other examples, the user's triggering action in the target application's interface can be that the user uses a specific function of the target application in the target application's interface, thereby triggering the terminal device 100 to display an AI interface. The AI ​​capabilities provided by the AI ​​options in the displayed AI interface can include the aforementioned specific function of the target application.

[0118] In the above-mentioned method for displaying the AI ​​interface, after displaying the interface of the target application, the terminal device 100 obtains the target content selected by the user in the interface of the target application. In response to the user's operation of dragging the target content to the edge of the screen of the terminal device 100 and hovering it, the AI ​​interface is displayed. The AI ​​interface provides one or more AI capabilities to process the target content, thereby enabling the terminal device 100 to display the AI ​​interface in response to the user's operation. This allows the user to conveniently and quickly use AI capabilities without having to interact with the AI ​​tool, thus improving the user experience.

[0119] It is understood that some or all of the steps or operations in the above embodiments are merely examples, and other operations or variations thereof can be performed in the embodiments of this application. Furthermore, the steps may be performed in different orders as presented in the above embodiments, and it is not necessary to perform all the operations in the above embodiments.

[0120] It is understood that, in order to achieve the above-mentioned functions, the terminal device includes hardware and / or software modules corresponding to the execution of each function. Based on the algorithm steps of the various examples described in conjunction with the embodiments disclosed in this application, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in conjunction with the embodiments, but such implementation should not be considered beyond the scope of this application.

[0121] This embodiment can divide the terminal device into functional modules according to the above method embodiment. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one module. The integrated module can be implemented in hardware. It should be noted that the module division in this embodiment is illustrative and only represents one logical functional division. In actual implementation, there may be other division methods.

[0122] Figure 15 This is a schematic diagram of the structure of a terminal device provided in another embodiment of this application. In the case where functional modules are divided according to their respective functions, Figure 15 A schematic diagram of a possible composition of the terminal device 1500 involved in the above embodiments is shown, such as... Figure 15 As shown, the terminal device 1500 may include: a receiving unit 1501, a processing unit 1502, and a sending unit 1503;

[0123] The processing unit 1502 can be used to support the terminal device 1500 in executing steps 401 to 403, and / or other processes used in the technical solutions described in the embodiments of this application.

[0124] It should be noted that all relevant content of each step involved in the above method embodiments can be referenced from the functional description of the corresponding functional module, and will not be repeated here.

[0125] The terminal device 1500 provided in this embodiment is used to execute the above-described artificial intelligence interface display method, and thus can achieve the same effect as the above method.

[0126] It should be understood that terminal device 1500 can correspond to Figure 3 The terminal device 100 shown. The functions of the receiving unit 1501 and the transmitting unit 1503 can be determined by... Figure 3 The processor 110, antenna 1, and mobile communication module 150 in the terminal device 100 shown are, and / or, implemented by the processor 110, antenna 2, and wireless communication module 160; the function of the processing unit 1502 can be implemented by... Figure 3 The processor 110, display screen 194, and touch sensor 180K in the terminal device 100 shown are implemented.

[0127] When using integrated units, the terminal device 1500 may include a processing module, a storage module, and a communication module.

[0128] The processing module can be used to control and manage the actions of the terminal device 1500. For example, it can support the terminal device 1500 in executing the steps performed by the receiving unit 1501, processing unit 1502, and sending unit 1503. The storage module can support the terminal device 1500 in storing program code and data. The communication module can support communication between the terminal device 1500 and other devices.

[0129] The processing module can be a processor or controller, which can implement or execute the various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination of functions that implement computing capabilities, such as a combination of one or more microprocessors, a combination of digital signal processing (DSP) and a microprocessor, etc. The storage module can be a memory. The communication module can specifically be a device that interacts with other electronic devices, such as radio frequency circuitry, a Bluetooth chip, and / or a Wi-Fi chip.

[0130] In one embodiment, when the processing module is a processor and the storage module is a memory, the terminal device 1500 involved in this embodiment can be a device having... Figure 3 The device with the structure shown.

[0131] This application also provides a computer-readable storage medium storing a computer program that, when run on a computer, causes the computer to execute this application. Figure 4 The method provided in the illustrated embodiment.

[0132] This application also provides a computer program product, which includes a computer program that, when run on a computer, causes the computer to execute this application. Figure 4 The method provided in the illustrated embodiment.

[0133] In this application embodiment, "at least one" refers to one or more, and "more than one" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent the existence of A alone, A and B simultaneously, or B alone. A and B can be singular or plural. The character " / " generally indicates that the preceding and following related objects are in an "or" relationship. "At least one of the following" and similar expressions refer to any combination of these items, including any combination of singular or plural items. For example, at least one of a, b, and c can represent: a, b, c, a and b, a and c, b and c, or a and b and c, where a, b, and c can be single or multiple.

[0134] Those skilled in the art will recognize that the units and algorithm steps described in the embodiments disclosed herein can be implemented using electronic hardware, computer software, or a combination of electronic hardware and software. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0135] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0136] In the several embodiments provided in this application, any function, if implemented as a software functional unit and sold or used as an independent product, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0137] The above description is merely a specific embodiment of this application. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the protection scope of this application. The protection scope of this application should be determined by the protection scope of the claims.

Claims

1. A method for displaying an artificial intelligence interface, characterized in that, include: Display the target application's interface; Obtain the target content selected by the user in the interface of the target application; In response to the user dragging the target content to the edge of the terminal device's screen and hovering it, an artificial intelligence interface is displayed, which provides one or more artificial intelligence capabilities for processing the target content.

2. The method according to claim 1, characterized in that, The AI ​​display interface includes: The AI ​​interface displays at least one pre-defined AI option.

3. The method according to claim 1, characterized in that, The AI ​​display interface includes: Depending on the type of the target application and / or the type of the target content, at least one AI option is displayed in the AI ​​interface; or... Based on the type of the target application and / or the type of the target content, and in conjunction with user habits, at least one artificial intelligence option is displayed in the artificial intelligence interface.

4. The method according to any one of claims 1-3, characterized in that, The AI ​​display interface includes: An artificial intelligence interface is displayed from the edge of the terminal device's screen toward the center of the screen.

5. The method according to any one of claims 1-4, characterized in that, The AI ​​display interface includes: The target application's interface and the artificial intelligence interface are displayed side-by-side in the same window.

6. The method according to any one of claims 1-4, characterized in that, The AI ​​display interface includes: The target application's interface and the artificial intelligence interface can be displayed in a split-screen or multi-window manner.

7. The method according to any one of claims 1-4, characterized in that, The AI ​​display interface includes: The artificial intelligence interface is displayed on top of the target application's interface.

8. The method according to claim 7, characterized in that, After displaying the artificial intelligence interface on the interface of the target application, the method further includes: In response to the user dragging the AI ​​interface to the edge of the terminal device screen, the AI ​​interface and the target application interface are displayed in a split-screen format.

9. The method according to any one of claims 1-8, characterized in that, After displaying the artificial intelligence interface, the method further includes: In response to the user triggering a minimized display operation, the artificial intelligence interface is switched to a minimized state.

10. The method according to any one of claims 2-3, characterized in that, After displaying the artificial intelligence interface, it also includes: Based on the user's operation of dragging the target content to the target option in the at least one artificial intelligence option and releasing it, the target content is processed by the artificial intelligence capabilities provided by the target option to obtain the first content corresponding to the target content.

11. The method according to claim 10, characterized in that, After obtaining the first content corresponding to the target content, the method further includes: Increase the display area of ​​the target option; The first content is displayed in the enlarged display area.

12. The method according to any one of claims 1-11, characterized in that, The AI ​​interface provides one or more AI capabilities, including the capabilities of the target application and / or the services provided by the target application.

13. The method according to any one of claims 1-11, characterized in that, The AI ​​interface provides one or more AI capabilities, including: The terminal device's operating system provides artificial intelligence capabilities. The services provided by the operating system of the terminal device; The terminal device's operating system provides artificial intelligence capabilities that can be combined with services within other applications. The services provided by the other applications; The artificial intelligence capabilities provided by the other applications; The other applications mentioned are third-party applications and are different from the target application.

14. The method according to any one of claims 1-13, characterized in that, After displaying the interface of the target application, the method further includes: In response to a user's triggered action on the target application's interface, an AI interface is displayed.

15. A terminal device, characterized in that, include: One or more processors; Memory; Multiple applications; And one or more computer programs, wherein the one or more computer programs are stored in the memory, the one or more computer programs including instructions that, when executed by the terminal device, cause the terminal device to perform the method as described in any one of claims 1-14.

16. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1-14.

17. A computer program product, characterized in that, The computer program product includes a computer program that, when run on a computer, causes the computer to perform the method as described in any one of claims 1-14.

Images